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ABSTRACT 



This detailed report of the national survey of competency based adult vocational instruction in 
the public and private sectors is one of four publications irom the project, "Identification and Analy> 
•sis of Competency- Based Adult Vocational Education Programs." The rationale for the survey, meth* 
odology, findings,xonclusions,,and recommendations are presented. Appended materials include 
detailed reports of 10 site visits to exemplary competency-based adult vocational programs. Data 
are presented on demographx variables, 19 competency based course descriptors, and six compe- 
tency-based criterion questions. Several comparisons are made between the public and private sec- 
tors, and descriptor scores are compared to other variables in the survey. Other analyses included 
linear regression and canonical correlations to determine the descriptors and criterion questions 
most closely related to strong programs of competency based adult vocational instruction. A pro- 
file of an exemplary competency-based adult vocational program. was described. Related project 
publications include the National Directory of Selected Competency Based Adult Vocational Edu- 
cation Programs^ Workshop Proceedings, and a final report. 
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PREFACE 



The applfCf.tion of competency-based education (CBE) concepts to all levels of education and 
training has grown rapidly. Adult vocational education appears to be particularly suited to CBE be- 
cause of the highly varied backgrounds, skills, and time requirements of adult learners. Recognizmg 
the importance of the CBE movement, the U.S. Office of Education sponsored the project, "Identi- 
fication and Analysis of Competency-Based Adult Vocational Education Programs," tp determine 
the status of CBE in adult vocational education. Further, a major project purpose .was' to proyide a 
vehicle for sharing and exchanging the information about competency-based adult vocational oro- 
grams. *^ 

This interim report contains detailed information about the national survey which.was con- 
ducted to identify competency-based adult vocational programs. The background of the study, 
methodology, findings, conclusions, implications and recommendations are the topics covered. Ten 
site visit reports describing the organization, curriculum, staff training, and strengths and weaknesses 
of selected exemplary programs identified in the survey are included. 

Special appreciation is due to the many individuals conducting competency-based adult voca- 
tional education programs who participated in this study, especially those who consented to in-depth 
intervi2v»/s regarding their programs during on-site visits by the project staff. Acknowledgments are 
also m order for the several consultants to the project who are named later in this report. The many 
individuals and groups representing state divisions of vocational education, local school systems, busi- 
ness and industry training departments, union sponsored training programs, the American Society for 
Training and Development (ASTD), public postsecondary and proprietary school administrators, and 
personnel of The Center fo- Vocational Education who nominated contact persons involved with 
specific compeftency based adult vocational programs are wiorthy of special acknowledgment. Finally 
appreciation is expressed to Dr. "ernardo R. Sandoval, Assistant Director, Manpower Program Devel- ' 
opment, Los Angeles City Unified School District, and to Dr. Lucille E. Wright, Educational Specialist, 
College of Education, Cleveland State University, for their critical reviews of this report-prior to final ' 
revision and typing. 

Recognition is given to the project staff for their diligent work in conducting the national survey 
analyzing the data, and writing this report: Earl B. Russell, Project Director; John Boulmetis Gradu- ' 
^'f^^!^^^ Associate; Cynthia K. Anderson, Program Assistant, Janet Rice, Research Specialist- and 
Mary McAnaney and Jane Leemhius, Secretaries. The support of Bruce A. Reinhart, Associate Direc- 
tor, IS also acknowledged. 

This interim report is one of four publications resulting from the project. The other three oub- 
lications are: *^ 

Identification and Analysis of Competency-Based Adult Vocational Education Programs 
(Final Report) 
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The final report contains information about project activities and accomplishments in- 
cluding the literature review, selection of a national panel of consultants, development of the 
survey instrument, data collection and analysis, planning and operation of the National Work- 
shop, project management activities, and major project findings and conclusions. The final 
report covers all aspects of the project. Two other products address specific proj ict activities. 

Proceedings of the National Workshop on Competency-Based Adult Vocational Instruction, 
August 2-5, 1977 

The workshop proceedings include transcripts of presentations made at the National Work- 
shop held at The Center for Vocational Education in Columbus, Ohio. Seventy-four participants 
representing public and private adult vocational education attended. Instructors or administra- 
tors representing six exemplary competency-based adult vocational programs identified in the 
national survey gave presentations describing effective programs and discussing implementation, 
course management, record keeping and other concerns educators have with CBE. Other pre- 
sentations included U.S. Office of Education activities related to competency-based adult voca- 
tional education. The Center for Vocational Education's involvement with CBE and adult voca- 
tional education, an overview of the survey reported in this publication, and adult vocational 
resources available from The Center for Vocational Education. 

National Directory of Selected Competency-Based Adult Vocational Education Programs 

The National Directory provides curriculum specialists and instructors with a reference for 
shanng and exchangmg information about competency-based adult vocational courses and pro- 
grams. Fifty seven courses and three programs are described in terms of methods used for iden- 
tifying tasks in the job analysis, development of performance objectives, delivery of instruction, 
student testing, course evaluation, and support systems. Names of contact persons with their 
addresses and telephone numbers are included to facilitate communication and pidnning of site 
visits;, as well as information regarding course length, number of competencies and objectives, 
and schedule. The National Directory is intended to be a documentary of illustrative exemplary 
courses and programs, and is an indicator of the potentialities of CBE in adult vocational instruc- 
tion in the United States. 



Robert E. Taylor 
Executive Director 

The Center for Vocational Education 
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CHAPTER I 
BACKGROUND OF THE STUDY 

Several trends have resulted in an emerging national commitment to adult education. Among 
these are the lowering birth rate and expanding life expectancy, an expanding technology with an 
increasing need for retraining to update job skills, and increased emphasis on lifelong career planning 
and adjustment. A 1977 report of the National Advisory Council on Adult Education concluded 
that a universal system of education that continues ti,<oughout every individual's lifetime is now a 
national priority. 

Various educators have suggested competency based education (CBE) as a roeans of offering 
more relevant and accountable instructional programs to students at all levels and all ages. Compe 
tency based adult vocational education is based upon occupationally valid tasks and consists of ele 
ments such as performance objectives, individuaHzed instruction and criterion referenced testing. 
In a CBE prograrh, students can become competent at the skills required in an occupation with max 
imum efficiency of time and effort. Instruction is designed to assist each individual student to de 
velop competencies in identified areas of weakness. Students work at their own rate on the skills or 
competencies releva^nt to their individual needs. CBE makes it possible for people to enter and exit 
the educational system throughout their lifetimes (Pucel & Knaak, 1975). 

The Problem 

Although competency based adult vocational education has many^ advantages, developing and 
implementing a program requires considerable time and expense. A job/task analysis must be con 
ducted or identified and performance objectives, learning activities, and criterion^eferenced tests 
need to be developed. Implementation and course management require constant surveillance. 

A vehicle for ^htiiii.g and exchanging information about existing competency-based adult voca 
.tional programs Wc*s recognized as a need to focus on existing successes to be utilized as models. It 
was conceived that certain information relative to competency based course development and course 
manageme..: could De generalized across subject areas and would also be helpful to practitioners in 
both the public and privatp sectors. 

^However, relatively little was known about the status of ongoing competency based adult voca 
tional programs. Large business and industrial firms were thought to be using competency based 
training methods to a sqbstantral degree. Through the use of Vocational Technical Education Con 
sortium of States (V TECS) catalogs,^ some adult vocational educators in the public schools are 



1 

Vocational Technical Educatiun Consortium of States iV TECS) catalogs are job-sequenced lists of performance objectives 
based on tasks performed by workers in specific occupational areas. The occupational areas covered m a V TECS catalog may include 
tasks foi several closely related job titles. Perfciimance guides foi each task explain step-by -step how each task is to be performed on 
the jub. standards are included thai indicate mimmum accepidbtc peitoimance. Ciiterion-ieferenced items provide a way to evaluate 
student accomplishment of a paiticulai task. Teacheis can use the catalogs as a guide to what isjequiied foi successfoi peitormanco 
the iOb. Tasks listed in the V TECS catalogs have oeen deterfTimed through extensive research and review by vocational teachers 
and workers on the job. 

The Consortium is a voluntary organization including 1 7 member states and two branches of the military. Catalogs fot approx 
imateiy 100 occupational areas have been developed. 
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implementing competency based instruction. Documentation pf these efforts and mformation about 
the status of CBE in adult vocational education was needed before efforts to share and exchange m- 
formaiion about successful programs could begin on a significant scale. 



The Rationale 

Competency based education can offer some important advantages to adult vocational education 
students. In a CBE program individual learners progress at their own rate to mastery of the mstruc- 
tional content. Students can learn according to their preferred learning style and build confidence 
by succeeding. The instructor can spend more time working with individual students and the presen 
tation of the content of instruction is assured to be consistent (Knaak, 1977). 

Burger and Lambrecht (1974) stated that in a competency-based program, student progress is 
monitored closely in relation to the stated objectives, allowing continuous diagnosis of difficulties 
and opportunity for remedial or alternate methods of instruction. Learners may have different in- 
structional goals depending upon their occupational interests and abilities within the program area. 
The identified competencies are job relevant because the job analysis has been the source of the task 
identification. 



, The Objectives 

In an effort to improve the quality of adult vocational education the project, "Identification 
and AnalyMs of Competency Based Adult Vocational Programs," was sponsored to meet the follow- 
ing objectives: 

1. Identify and describe characteristics of specific competency based adult vocational edu 
cation programs in public and private vocational education. 

2. Provide a vehicle for adult vocational program developers and operators to "share and 
exchange" and "train and be traified" in the competency-based education concept. 

3. Provide the profession with information and supporting data on the status of competency- 
based education in adult vocational education programs sponsored by business, industry, 
and education so that developers end operators will have a readily available source of as- 
sistance. 



Literature Review Highlights 

A literature review was conducted early in the project to. (a) aic| in the identification of com- 
petency based programs in adult vocational instruction in business/industry, labor, education and 
government agencies, (b) to establish the descriptors for a competency based course, and (c) to de- 
termine the extent of documentation of knowledge in the area. 

The most frequently addressed area in the literature involved^definitions of CBE or discussion 
about the characteristics of con%.etency based programs. Comm /n elements of the various def ini 
tions were, individualized instruction based on d task analysis, emphasis on exit requirements, time 
variable with achievement held constant, performance objectives, criterion referenced testing, and 
students held accountable for their progress. Houston (1973) stated: 
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Competency-based education (CBE) is characterized by its rigorous reliance on 
objectives which set the parameters for both instruction and evaluation. Such 
objectives are derived from the role of the practitioner rather than the logical 
structure of traditional disciplines. Objectives are clearly stated, explicit, defined 
in terms of what the learner is to demonstrate, and made public, (p. 200) 

Spady (1977) defined CBE as: 

A data-based, adaptive, performance oriented set of integrated processes that 
facilitate, measure, record, and certify within the context of flexible time 
parameters the demonstration of known, explicitly stated, and agreed upon 
learning outcomes that reflect successful functioning in life roles, (p. 10) 

He distinguished CBE from competency based teacher education, mastery learning, individual- 
ized instruction, and applied performance testing. 

Student motivation was often cited as an advantage of CBE. When students understand the 
concrete objectives established for them to achieve and personally identify with the objectives, they 
perceive the instruction as being particularly relevant and meaningful. Motivation then becomes a 
personal matter, and gratification through successful accomplishment permeates the instructional 
process. Students know the instruction is job relevant when it is based on an analysis of the job. 
Success experiences, evident at each step in the learning process, are motivators. 

CBE is suggested as a means of improving educational programs at a time when program account- 
ability is being stressed. Competency based adult vocational education programs ^.e based on the 
premise that the instruction will improve/insure job performance. With competencies identified and 
defined, educators and trainers will be able to demonstrate that learning has occurred. 

Adult learners have varying goals, aptitudes, abilities, needs and job or career preferences. The 
flexibility of CBE allows the educational program to effectively accommodate these dif Terences. In 
a competency based course adults may enter at the level appropriate for their abilities and exit when 
they have attained the necessary competencies for achieving their goals. They may receive credit for 
the competencies they already possess and begin the educational process at their level of expertise, 
avoiding duplication of effort. Hertling (1974) stated: 

CBE is particularly suited to adult education programs because adults have often 
acquired a wealth of practical experience which may enable them to demonstrate 
attainment of specific competencies without taking formal course work. Thus, 
they would be given credit for competencies which they have already acquired. 

Adult students do not have time to learn the "nice to know" areas of vocational instruction. In 
a CBE program students can master those competencies which lead to attainment of the occupational 
goal. Because the identification of tasks performed in occupations is the initial step m developing a 
competency based vocational curriculum, the competencies learned are job relevant. 

The final report. Identification and Analysis of Competency-Based Adult Vocational Education 
Programs, contains a much more extensive review of the literature, including the following six areas. 

• The Nature of CBE 

• Application of CBE to Adult Vocational Programs 
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Developing and Implementing CBE 

Use of CBE in Business, Industry, and Labor Training 

Problems Involved with CBE 

Favorable Aspects of CBE 
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CHAPTER II 



METHODOLOGY 



This chapter contains a description of the strategies and procedures used to collect and analyze 
data gathered through a national survey of agencies dealing with competency based adult vocational 
education in both the public and private sectors. Sample selection, consultant inputs, instrument 
development, data collection, and data analysis procedures are addressed in detail. 



Population and Sample 

Competency based adult vocational programs operating in both the public and private sectors 
in the United States were sought. The only restriction placed on the inclusion of these adult voca- 
tional programs was the elimination of degree granting program.s or credit courses of any type, con- 
sistent with the meaning traditionally associated vyith adult vocational education by federal legisla- 
tion and the U.S. Office of Education. Within this constraint the,project staff was interested m 
identifying adult vocational programs in both the private and public sectors, day and/or evenmg, m 
virtually any type of school or training facility. 
*■ * 

Initial Contacts 

In order to access the public sector, the names of the state directors of adult education, state 
directors of vocational education, and directors of postsecondary vocational technical schools or 
community colleges were obtained from the mailing list used by The Center for Vocational Educa- 
tion to distribute its Centergram monthly newsletter. This mailing list covers an international audi- 
ence of approximately 10,000 people. The subgroup of interest in the mailing list totaled 512 
individuals. 



Additionally, individuals in approximately 75 government.agencies were asked to identify pro- 
grams/courses with which they were associated or acquainted. These contacts and those discussed 
in the previous paragraph received an initial letter (Appendix A) requesting nominations of person- 
nel associated with competency based adult vocational programs. To simplify this task a form for 
names and addresses of contact persons and a self ajddressed, stamped envelope were enclosed. 

An announcement (Appendix B) was published in the December 1976 issue of the Centergram, 
describing the project and requesting assistance in identifying programs. A similar announcement 
(Appendix C) was sent to 76 professional journals and newsletters. At least 20 publications re-, 
sponded to the request for assistance in the search. A number of contact people mentioned the an- 
nouncement in their correspondence. 

The private sector was Sjsarched extensively. The national headquarters of the American 
Society for Training and Development (ASTD) was contacted, and a random sample iist of 1,000 
members was purchased. From this list 500 names were selected after company duplications, geo- 
graphical overlap, and public sector members were deleted. These people received a letter (Appen-. 
dix D) with the nominating form (Appendix A). 
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From the Fortune magazine list of 500 leading U.S. businesses and industries in 1976, a sam 
pie of 50 companies was selected which were believed most likely to have extensive m house tram- 
ing Ri:ograms. /The basis for this selection was size, scope, and probable existence of employee 
trainin&-facili,lies. These companies received the same letter that was sent to the ASTD member- 
ship sample .(Appendix D). 

The 1976-77 directory of the National Association of Trade and Technical Schools (NATTS) 
was reviewed and a sample of 200 schools was drawn to receive a similar letter. The director of the 
^hool was asked if they conducted competency based adult vocational courses and, if so, if they 
would oe interested in participating in the survey. To expedite this step, a postcard was enclosed 
on vvjiich they could indicate their intent. Also, in this step directors could indicate the number 
of instructor surveys needed if they wished to participate. 

' Lists of the members of the National Transportation Apprenticeship Training Council 
'(NTATC) and the members of the Maritime Trade Advisory Board (MTAB) were obtained from 
Hazel Brown, one of the project consultants. These members were contacted by a letter (Appen- 
dix E) asking that they nominate persons involved with programs which met the established criteria. 

Marie Piekarsky, project consultant, provided a list of key people who operated or knew of 
people who operated competency based programs in«lhe health professions. This group was con 
tacted {Appendix F) to ask for their assistance in identifying appropriate programs. 

Staff members at The Center for Vocational Education who had been or were in the process 
of operating projects wh^ch dealt directly or interfaced ;vith the private sector contributed a list 
of agencies to consider. The ASTD letter (Appendix D) was sent to this group because the activ- 
ities of both groups were similar. 

Subsequent Contacts ✓ ' 

In many cases the public sector contacts nominated people at the state department of educa. 
tion level These people were no. the target group, i.e., qualified to describe in detail a specific 
competency based vocational program or course. Therefore, in order to locate programs at the 
local level, a letter (Appendix G) was designed asking people to nominate local school contact 
persons. This letter was sent to the above public sector nominees with the more specific request 
for nannes of people involved with competency based adult vocational programs in local schools. 

Those people nominated to participate in the survey were placed on a cumulative list of po 

tential respondents. Where nominations were administrators rather than teachers, a letter and 

postcard was mailed (Appendix H). The purpose of this letter was to determine whether these 

schools possessed competency based adult vocational courses, arid whether they wished to par 

ticipate in the survey. To expedite this inquiry, a postcard was enclosed for indicating intent. 

Administrators indicated the number of instructor surveys needed if they wished to participate. 

It had been suggested that several programs of the National Association of Trade and Technical 

Schools (NATTS) were competency based. The 1976 77 directory of NATTS was reviewed and 

a sample of 200 schools was drawn to receive the letter and postcard sent to the administrators. 

The responses to these inquiries were placed on the list of potential respondents. 

♦ 

Approximately 1,900 program contact persons were nominated through the variety of pro 
cedures described.^ The cumulative list of potential respondents was scrutinized to avoid duplica 
tion of nominees or programs within a school prior to mailing. This final list contained 1,657 
nominations to participate in the survey. 
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In addition, a survey and letter (Appendix I) was sent to each of the 99 ASTD chapter presi 
dents asking for their assistance in publicizing the project to their members and in making the 
survey and copies available to those wishing to respond. 



Project Consultants 

Through the numerous contacts received from project mailings and through the review of 
the literature, several persons surfaced as having particular knowledge, experience, or expertise 
in competency based adult vocational programs. These people were from both the private and 
public sectors, from the administrative and instructor levels, from curriculum development to 
administration. From a list of approximately 35 such individuals, seven were chosen to compose 
the National Panel of Consultants (Appendix J) to the project. Two others (Bill J. Koscheski of 
the Vocational Technical Education Consortium of States and B. R. West of the Indiana State 
Department of Education) were selected to review the instrument. 

Koscheski and West were asked to ponder the concept of competency based adult vocational 
instruction, to specify tentative competency based descriptors, and to suggest a possible means of 
measuring them. They were then asked to compare the project survey form with their conceptual- 
izationsand to make summary recommendations. 

The National Panel of Consultants was convened at The Center to refine the instrument, 
, to discuss the project staff's conception of CBE. and to structure future project activities. The 
consultants generated intensive critiques of project activities and suggested improvements m the 
data collection plan. 



Instrument Development 

One particular component of the literature search was to identify particular descriptors 
which appeared to be basic to competency based instruction. As a result, a preliminary list was 
developed and synthesized into questionnaire items. These items were further refined so that 
there was litt^le or no a^jparent overlapping and they constituted one section of the instrument. 
In addition to these descriptors, a number of demographic questions were generated for another 
section, a^nd a rough format for opep ended course descriptions was designed as a third section. 
The project staff decided that the survey should be somewhat difficult to complete, contrary to 
common practice in survey research. The rationale for this decision was that only those people 
who were conducting competency based programs and wished to proliferate the concept of 
competency based adult vocational instruction should take the time and effort to respond. 

These three sections were conipiled, resulting in the first of.several drafts of the instrument. 
The draft instrument then was reviewed by two Center staff members, each of whom directs a 
CBE related project. This review resulted in the development of another draft of the instrument. 

This draft was mailed to the tw^o outside consultants for review, as discussed previously. 
Their review led the project staff to revise the instrument again. 

This draft was reviewed by a gr;oup of three private sector reviewers who, in a meeting vyith 
the project staff, reviewed the cover; letter and the entire instrument. This rather extensive review 
not only resulted in a more conuise;instrument, but it also led to some restructuring in order to 
appeal to the private sector as well as to the public sector. An additional ogtcome of this meeting 



was the suggestion to have separate cover letters (Appendix K) designed for the public and private 
sectors. Also, it was suggested that the sequencing of the sections be arranged so that the more 
interesting course descriptors were in Section I, the more difficult demographic information in 
Section II, and the most difficult open ended questions in Section III. Both of these suggestions 
were adoptevi. This draft was then further reviewed by the project staff for inconsistencies, to 
make the response options equivalent, and to remove irrelevant items. 

This version was Submitted to the National Panel of Consultants for comment and revision. 
The consultants met to review the project and to critique the instrument. The consultants recom- 
nnended that several items be deleted and that rewording/restructuring of other items be consid- 
ered. The suggestions were incorporated in a subsequent draft of the instrument. An additional 
outcome of this review was the addition to the survey of a glossary of terms so that all respondents 
would have the same understanding of common terms. This glossary is contained in Appendix L. 

CBE programs in Minnesota and Ohio were identified, and a total of 15 were selected as pilot 
test sites. These programs included both public and private sectors, although most werejn the pub- 
lic sector. The purpose of the pilot test was to have instructors complete the instrument to deter- 
nnine difficulty of items, time needed, appropriateness of items, and especially the degree tg which 
the instrument was helpful in collecting accurate information on the courses. 

The pilot test was administered in Ohio on site with a member of the project staff present to 
assist with any questions. In Minnesota it was administered by the Adfult Vocational Director m 
a large school system with many adult vocational instructors. The instructors' suggestions were 
incorporated in the questionnaire at the completion of the pilot testing. 

This draft was reviewed by the project staff and refined to include boxe? for responses, key- 
punching codes, and a project logo. A copy of the final instrument is contained in Appendix M. 



Data Collection 

The mailing of the letter to approximately 350 administrative contacts with an enclosed post- 
care (Appendix H) was followed up by a telephone cal^to a random sample of 15 non-respondents. 
The calls were made to determine whether there was some particular reason why they failed to re- 
spond. Table 1 contains a representation of the responses received from this follow-up. A review 
of the table reveals that the majority of those contacted indicated that they never received the 
Jetter or that there was no response since the school offered no CBE courses. These and the re- 
maining responses indicate that the persons failing to return the postcard were different from those 
who did return the postcard in that they either did not have a CBE program or did not wish to par- 
ticipate. 

The survey was mailed early in April 1977 to 1,657 individuals. Each recipient received a 
cover letter (Appendix K), a glossary of terms (Appendix L), a copy of the instrument (Appendix 
M), and a brochure {Appendix N) which further described the intent and goals of the project. 
The survey was designed so that upon completion the respondent was to simply fold it in half, 
fasten it, and mail it. Postage was pre paid and the return address was printed on the back. 

After 10 working days, a follow up request (Appendix 0) was mailed to non-respondents. 
This letter described the survey and reemphasized the importance of responding. 

After 20 working days, a random sample of 98 non respondents was taken, and a telephone 
follow up was conducted. In Table 2 the responses to this further inquiry are described. As 
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Table 1 



Findings of the Telephone Follow-up 
of Postcard Non-Respondents^ 





Number 


Percent 


Never received the letter 


5 


33.3 


No CBE courses 


4 


26.7 


Passed letter on to subordinate 


2 


13.3 


No longer at address 


2 


13.3 


Not sure whether CBE 


1 


6.7 


Not reachable 


1 


6.7 


TOTALS 


15 

ija 


100.0 



^As of date of follow-up, 189 postcards had been returned. 



Table 2 

Findings of the Telephone Follow-up 
of the Survey Non-Respondents® 



Response to Call 


Number 


Percent 


Survey is in the mail, being completed, passed on 






to subordinate or received during follow-up 


35 


35.8 


Person unreachable (on vacation, no phone. 






no answer, etc.) 


20 


20.4 


Person never returned call after two tries 


14 


14.3 . 


Program/course not CBE 


10 


10.2 


Person no longer employed in program 


6 


6.2 


Person did not receive the survey (sent another) 


5 


4.6 


Program/course not adult education 


3 


3.1 


Pt "oram/course degree granting 


2 


2.1 


School out of business 


1 


1.1 


No time to complete survey 


1 


1.1 


Respondent non- English speaking 


1 


1.1 


TOTALS 


98 


100.0 



^As of date of follow-up, 232 usable surveys had been received. 
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indicated in this table the largest number of respondents said that the survey was m the mail, m 
the process of being completed, or passed on to a suuordinate (and would be checked'on). An 
interesting aside is that of the 35 respondents answering this way, only four surveys were returned. 

To help determine the sensitivity of the instrument, based on high scores and unusually good 
course descriptions, 10 exemplary programs were selected for on-site visitation. In-depth mter- 
views provided mo'e detailed information than was possible to obtain by questionnaire. These 
programs were scattered throughout the nation and represented programs in the private and public 
sectors. A list of those programs and the site visit reports are in Appendix P. 

Where possible classes/training sessions were obser/ed so that an accurate impression of com- 
petency-based instruction could be gained. For the most part the on-site visitation consisted of 
conversation with those people responsible for the development, operation, and/or management 
of the program. Questions asked and information gathered pertained directly to the mechanics 
of the course{s) and course structure. Data gathered were compared with the program's completed 
survey to assess the survey's sensitivity. Considerable data were obtained relative to the adminis- 
tration of programs. This information proved most valuable in identifying topics and presenters 
for the National Workshop held in conjunction with the project. 

After each site visit, an extensive report was completed by the observer relative to ail aspects 
of the visitation. Site visit reports are included in Appendix P. 



Data Analysis 

The analyses performed on the response data were primarily exploratory in nature. The in- 
strument, designed for computer analysis, included the coding of open-ended responses. This sec- 
tion contains a description of the coding of the instrument, the analyses performed within each 
of the three sections of the instrument, and the analyses performed among the three sections of 
the instrument. 

Coding 

The instrument was designed so that respondents would mark their answers in a box(fes) 
placed at the far right of each item. Beside each box were numbers instructing the keypunch 
operator in which columns the data were to be punched. This pre-planning was perforrned for 
Sections I and II. However, it had not been planned that Section III would be content analyzed 
but used only for entry into the National Directory. As responses began to arrive, project staff 
discovered that the comments in Section III were quite valuable from a qualitative standpoint 
and warranted inclusion in the data analyses. 

The six open ended items in Section III were content analyzed to determine if there were 
any particular aspects which. tended to exemplify strong programs on the one hand and weaker 
programs on the other. Strength, here, refers to the extent to v^/hich descriptions v;^re suppor- 
tive of descriptors of exemplary competency based instruction that were contained m Section I. 
Categories and criteria identifying these categories were formed so that the six open-ended items 
could be weighted "1" for strong evidence, "2" for moderate evidence, and "3" for weak evidence. 
These items were weighted 1, 2, or 3 and a total of these six scores was calculated and coded. 
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Analysis of Sections I, n,and III 



Frequency counts were generated for each of the items on the instrument as well as the en- 
coded items in Section III. The :>ldtistics computed were the mean, median, mode, range, minimum 
and maximum scores, variance, standard deviation, and standard error. All were computed due to 
the different levels of measurement contained in the instrument. For instance, where the mean 
might be an inappropriate statistic to report, the median would also have been computed and avail 
able for reporting. 

An additional analysis which was performed on Section I consisted of totaling the responses 
for each of the 19 descriptors. This was performed only after all responses of "^-unusable or not 
applicable" were converted to "3-does not possess." This conversion was made because either 
response, in effect, had the same meaning. These totals were then divided into three categories re- 
presenting high, medium, and low scoring programs. 

Two analyses were performed to investigate the relationship between variables, ih Section I 
and the variables (criterion questions) in Section III which indicate the extent to which a course is 
competency based. The first analysis was a linear regression in which the sum of the six compe- 
tency based variables or criterion questions (Section III) comprised the criterion and the 19 course 
descriptor variables (Section I) the predictors. The second analysis was a canonical correlation. 
One set ot variables included the 19 course descriptor variables, and the other consisted of the six 
criterion questions from Section III. The purpose of these analyses was to detern^^me which course 
descriptor variables and criterion questions were most closely related to strong programs of com- 
petency-based adult vocational education. 
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CHAPTER III 
FINDINGS 



As a result of the project survey, a number of important findings were determined about the 
status of competency based adult vocational education programs. These findings will be presented 
and discussed in this chapter. 



Descriptive Data 

Responses 

In response to the project survey, 277 usable responses were received. These survey responses 
came from 42 of the 50 states and the Virgin Islands. The persons selected to receive the survey 
were identified 6y procedures which were discussed in Chapter II. The relatively low response rate 
to the survey, in spite of follow i.p procedures used and the 14-week period for accepting returns, 
should not be too surprising. Several persons who provided nominations indicated that they were 
not sure who was involved with competency based adult vocational programs, so they frequently 
sent personnel or institutional directories of various'kinds, or nominated people who "may be in- 
volved/' Also, few people making nominations expressed confidence that their nommeeb were out- 
standing prospects for the survey. In addition, as was explained in Chapter 1 1, project staff deliber- 
ately planned for the instrument to be difficult to complete so that responses from relatively 
weak competency-based programs might be discouraged. 

Figure 1 illustrates the extent of the original canvassing, the number of referrals received, the 
number of surveys sent, and the number of surveys returned. These figures are further divided into 
the private and public sectors in order to illustrate the extent of coverage within each group. 

As shown in this figure, a concerted effort was made to include the privatejectqr because 
the project staff originally suspected it wa«= *here that most competency-based isntruction occurred. 
But,'more referrals were received from the jblic sector than the private sector, resulting in more 
surveys being sent to the public sector than the private sector. The usable response rate was 12.1 
percent from the private sector and 19.6 percent from the public sector, or 16.7 percent overall. 

Althpugh the return rate was low in both cases, it was higher from the public sector than from 
the private. A plausible explanation for the relatively poor response from the private sector is per- 
haps the proprietary concerns of competitive practices coupled .with the desire "to keep a good 
thing secret." Also, it is conceivable that the responses did, in fact, indicate the extent of compe- 
tency based training in the private sector. Among those who responded, chi square (x^) analysis 
revealed a significant difference between private and public sectors on the "do not publish" option 
in Section III of the questionnaire (x^ - 4.99, p < .05) with a relatively high proportion of respon- 
dents from the private sector being unwilling to have their course description printed in the National 
Directory. 
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NUMBERS OF 
PROGRAMS 
1600 



1200 



800 



400 



1030 




599 



36.7% 



1238 



693 




64.1% 



1015*= 



642^ 




61.3% 



\PRIVATEt 



324 



103 



\24.1%^ 



75.9% 



PUBLIC 



199 



78 



71.8% 



ORIGINAL 
CONTACTS 



REFERRALS 
RECEIVED^ 



SURVEYS 
SENT 



SURVEYS USABLE SURVEYS 
RETURNED RETURNED 



^THESE NUMBERS MAY INCLUDE SOME DUPLICATES SINCE MORE THAN ONE PERSON MAY HAVE 
REFERRED A PERSON OR PROGRAM. 

*^HIS NUMBER INCLUDES ASTD CHAPTER PRESIDENTS. 

^HIS NUMBER INCLUDES PROGRAMS CLASSIFIED "OTHER." 



FIG. 1. CONTACTS AND RESPONSES FROM THE PRIVATE AND PUBLIC SECTORS 



At any rate, for whatever reasons, the respondents to the survey were heavily represented by 
the public sector. In fact, the majority of those responding from the private sector were proprietary 
schools and not business, industry, or labor training departments. In Table 3 the response rates for 
each group surveyed are Indicated. Table 3 Indicates that many of the returned surveys were not 
usable. Most of the unusable returns resulted from incomplete responses in Sections I and II of 
the questionnaire. A few weft, unusable because they were from degree-granting programs. 

Characteristics of Programs 

Section li of the survey contained items concerning demographic characteristics of the re- 
spondents' programs. Some of these items, such as questions about placement and follow-up . 
programs, were not unique to competency based programs. Others were, such as questions about 
open entry/open exit options, and the number of terminal performance objectives based upon 
competencies (tasks) identified in a job analysis. 

Types of courses. The competency based adult vocational courses identified tn the survey 
were categorized by the six recognized vocational education service areas, even thougri many of 
the courres are taught in the private sector. As the data in Table 4 indicate, over half of the courses 
were cidssified in the trade and Industrial education area. Business and office educatio n courses 
comprised almost 12 percent. Very few courses were found m distributive education (2.5 percent), 
home economics (1 percent), and agricultural education (less than 1 percent). A miscellaneous 
category, which made up almost 9 percent of the total, consisted of courses in management training, 
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Table 3 

Survey Returns Categorized by Respondent Types 



Types of 
Respondents 



Total Surveys Mailed 
%of 

Number total 



Total Returns 

% of these 
Number mailed 



Usable Returns 

% of those 
Nuntber mailed 



Business, Industry & 

Union 264 

P^iblic Secondary & 
Technical Institutes- 
area voc. sch., sch. 
district contacts 548 

Adult Skills Centers- 
skills centers 82 

Proprietary Schools .254 

Junior & Community 

Colleges 241 

Universities 37 

Other— city govt., 
hospitals, health 

training 107 
ASTD Chapter 

Presidents' 124 



15.9 

33.2 

4.9 
15.3 

14.5 
2.2 

6.5 
7.5 



49 

143 

44 
54 

80 
11 

46 



18.6 

26.1 

53.7 
21.1 

33.2 
29.7 

43.0 



34 

75 

40 
44 

31 
10 

43 



12.9 

13.7 

48.8 
17.3 

12.S 
W.O 

40.2 



TOTAL 



1,657 



100.0 



427 



25.8 



277 



16.7 



^ ASTD members come from both the public and private sectors. Chapter prp^.dcnts distributed the surveys to 
members, so the category of th^se survey recipients canno« be determined, although most were thought to be in 
the business, mdustry, labor category T.Sc responses Uom this group are spread across the other categories, based 
qpon identifying information provided In Section 111 of the questionnaire. 



Table 4 

Categories of Course Titles Reported 



Service Area 


Number 


Percent 


Agricultural Education 


2 


0.72 


Business and Office Education 


61 


22.02 


Distributive EdMcation 


7 


2.53 


Health Occupations 


33 


11.91 


Home Economics 


3 


1.08 


Trade and Industrial Education 


147 


53.07 


Miscellaneous 


24 


9.67 


TOTAL 


277 


100.00 
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instructor training, and others that were not classifiable In the typical /ocational education'service 
areas. A more detailed classification of courses is contained in a companion publication, The Na- 
tional Directory of Selected Competency Based Adult Vocational Education Programs. 

i. 

Duration of courses. Respondents were asked to report the minimum, average, and maximum 
hours that were required for an adult to complete the course. Where hourly designations were not 
applicable, respondents could identify their courses as completely open entry/open exit. The re- 
sponses to this item are displayed in Table 5. A review of this table indicates that the variability of 
the hours required was large, ranging from one hour to 9,600 hours. 

Table 5 



Duration of Courses in Hours 




n 


Mean 


Median 


s.d. 


Range 




Minimum Hours 


166^ 


515.8 


140.5 


833.9 


1-8,000 




Average Hours 


170^ 


545.1 


160.5 


947.6 


2-8,000 




Maximum Hours 


162^ 


658.2 


220.5 


1,111.9 


3-9,600 





"There were 80 respondents (29 percent of the total) who reported their programs were completely open entry/ 
open exit. 



However, when looking at the median of the distributions (which is more appropriate than the 
mean since the median \s not affected by the few extreme scores), there is evidence that these 
competency based courses tend to take less than an academic or fiscal year to complete. This 
finding, when viewed with the monjths in yvhich courses operate (Table 6), indicates that students 
could conceivably complete several courses within a program year (I'f the courses are sequenced) 
and that courses can service several groups of students during a program year. 

As indicated in Table 6, most courses operate on a year-round basis. Those which do not 
operate year round tendto follow the academic schedule of nine mpnths, September through May. 

There were 80 courses (29 percent of the total) in which no definite number of hours was re- 
quired for completion. Students are allowed to enter when they wish and to exit when they com 
plete the work. This open entry/open exit characteristic is generally viewed as a major criterion 
of competency-based instruction. 

Competencies and terminal performance objectives. Two related questions in Section II 
asked respondents to (1 ) specify the number of competencies (tasks) identified for the entire 
course based upon the job analysis and (2) to specify the number of terminal performance ob- 
jectives included in the course based upon the competencies (tdsks) identified^ These data are 
reported in Table 7. A substantial number of respondents did not complete these items, 233 
responded to the first of these items and only 216 responded to the latter. With 44 respondents 
omitting the first question and 61 omitting the second, the clarity or specificity of some of the 
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Table 6 

Frequency Distributions of Months Courses are Offered 



Yes No 

Month(s) Offered 1 



All 

AH Year 


151 


54,5 


126 


45.5 


January 


112 


40.4 


165 


59.6 


February 


113 


40.8 


164 


59.2 


marcn 


119 


43.0 


158 


57.0 


April 


113 


40.8 


164 


59.2 


May 


110 


39.7 


167 


60.3 


June 


66 


23.8 


211 


76.2 


July 


39 


14.1 


238 


85.9 


August 


30 


10.8 


247 


89.2 


September 


106 


38.3 


171 


61.7 


October- 


114 


41.2 


163 


58.8 


November 


113 


40.8 


164 


59.2 


December 


1G2 


36.8 


175 


63.2 



^The percentages of "Yes" responses for the individual months are lower than they should be since respondents 
who checked "All Year" did not check the individual months. 



Table 7 

Competencies (Tasks) and Terminal Performance 
Objectives Reported for Courses 



Item Mean Medi§n Range 



Competencies (tasks) identified for course (n = 233) 72.0 31.2 1-999 

Terminal performance objectives, based upon com* 

petencies (tasks) included In course (n = 216) 59.6 23.5 1-870 
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competency based courses identified by this survey Is not known. A few of these respondents pro> 
vided persuasive evidence of competency based. Instruction in the open ended Section 1 1 1 of the 
questionnaire. As indicated in Table 7, the median number of competencies (tasks) identified for 
the courses was 31.2, ranging from 1 999. The median number of terminal performance objectives 
reported was 23.5, ranging from 1 870. In both cases the means are spuriously high due to a few 
extremely large numbers being reported for each question. 



Enrollment by sex. Respondents were asked to indicate the approximate total enrollment in 
their courses by the learner's sex. This information is provided in Table 8. Female enrollments were 
reported in 209 courses by the 277 respondents, and males we'^e enrolled in 228 courses. A large 
majority of the courses identified in the survey had both female and male enrollments. The median 
number of females gnrolled was 16.2, ranging from 0 348. The medi^an number of males enrolled 
was 21.9, ranging from 0 999. It appears that th^ large enrollment may best be explained by some 
courses being offered several times a year, with annual enrollment being reported in those cases. 

4 

Table 8 



Course Enrollment by Sex of Learners 

r 


Sex 


Mean Median 


Range 




Female (n = 209) 


35.4 16.2 


] 

0-348' 




Male (n ^ 228) 


54.6 21.9 


0*999 





Advisory councils, placement programs, and follow-up. The use of advisory councils was a 
common feature of the courses surveyed, being reported in 69 percent of the cases. The response 
to the survey on this item is shown in Table 9. Respondents were asked whether the course had 
an "active" advisory council, which would encourage those respondents who had used an advisory 
couricil at one time- but not recently- to respond "No." An assumption was.made that an "m 
active" advisory council would be about the same as not having an advisory council. 

Table 9 

Frequency Distributions of Individual Program Elements 



ft ^, Yes No Other Total 

Program Element 



% n % n % 



Advisory Council 191 * 69.0 86 31.0 0 0.0 277 100 

Placement Program 166 60.6 72 26.3 36 13.1 274 100 

Follow-up System 184 70.0 58 22.1 21 8.0 263 100 
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Placement programs were also reported to be active in almost 61 percent of the respondents' 
courses. Table 9 illustrates the responses to the item asking whether the course had a placement 
program for completers. The majority of respondents noted that they had such a program. Many 
of the respondents who did not report placement programs indicated that (1) their course was 
merely a component of a larger program which had an overall placement program or (2) that the 
course was part of an employee training program, meaning the students were already employed. 

. When asked whether the courses had some form of a follow-up system for course completers, 
70 percent of the respondents indicated that they did. The responses to this survey Item are in- 
cluded in Table 9. Some respondents indicated that they were either developing such a procedure, 
were part of a larger system, or it was not applicable. 

The make up of these advisory councils was also investigated, and Table 10 illustrates these 
findings. Members of business and industry tended to be highly represented on these councils, 
with school officials also comprising much of the membership. The high percentage of business 
and industry members reported among active councils indicates interest in adult vocational pro- 
grams by the private sector. One thing to be emphasized, however, is that "active" was not de- 
fined and could be interpreted to mean anything from monthly to yearly meetings, from genuine 
involvement to rubber stamping. 



Table 10 

Frequency Distributions of Advisory 
Council Member Types 
(n=277) 



Yes No 

Type of Member „ o/ 



Union Representatives 


44 


15.9 


233 


84,1 


Business Representatives 


132 


47.7 


145 


52.3 


Industry Representatives 


140 


50.5 


137 


49.5 


University Representatives 


29 


10.5 


248 


89.5 


College Representatives 


37 


13.4 


240 


86.6 


School Officials 


131 


47.3 


146 


52.7 


Community Leaders 


83 


30.0 


194 


70.0 


Private Proprietary School 
Officials 


21 


7,6 


256 


92.4 


Others 


51 


18.4 


226 


81.6 
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Facility. Respondents were asked to report the type of facility m which coufi^es were con- 
ducted. The item was designed to gather data on the type of institution or agency providing the 
course. The types of facilities represented in the survey sample are reported in Figure 2. 




FIG. 2. TYPES OF FACILITIES IN WHICH COURSES WERE OFFEMED 

(n=277) 



Proprietory schools, adult skills centers, public technical institutes, public secondary schools, 
and junior/community colleges were almost equally represented among the respondents. The 
"Other" category represented courses conducted in adult evening programs, technical colleges, 
and private schools that seemed to be combinations of the facility choices provided in the ques- 
tionnaire. There were four responses to the survey from courses being conducted in union spon- 
sored facilities. All four of these responses were from a school operated by the Seafarers' Inter- 
national Union. The person who completed the questionnaire checked both 'Industry " and "Unic 
Sponsored" facility, so the former designation was selected for data analysis. 

Problems shared by respondents. An open ended question in Section II was. "Would you 
please '^hare w**h vs any pro^-'pms that you might have encountered in leveloping j' t ng 

this competency based course?" Respondents shared 132 problems. These were content analyzed 
9nd grouped into five areas, as shown In Table 11. The most common type of problem mentioned 
(31 percent) related to the adult learners enrolled. Most respondents vyho reported this type of 
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problem represented adult skills centers, which work to a relatively large extent with the unem- 
ployed or the underemployed, the unmotivated, and those who are the victims of economic and 
social discrimination. 

Keeping the curriculum up to date was the next most common problem (27 ptrcent), fol- 
lowed by administrative and organizational difficulties (24 percent). Nine percent of the problems 
mentioned involved lack of time, and 8 percent of the problems emphasized inadequacies in mate- 
rials and equipment (Table 11). 

^ Table 11 

Problems Mentioned in Developing and Operating 

Competency 'Based Courses ^ 



Problem Types 


Number 


Percent 


Learner problems (e.g., low ability levels, unqualified) 


41 


31.1 


Keeping the curriculum up-to-date 


36 


27.3 


Administrative and organizational difficulties 


32 


24.2 


Lack of time 


12 


9.1 


Materials and equipment 


11 


8.3 


TOTALS 


132 


100.0 



Ideas for improvement. A follow up question to the one regarding problems with competency- 
based courses asked: "Would you please share wit^i us.any ideas on how your competency-based 
course can be improved?" Respondents offerco 1 17 suggestions for course improvement. Nearly 
half the ideas were in the area of curriculum and program revision. Another 18 percent of the 
ideas for improvement called for updated materials and equipment, seemingly closely related to 
curriculum and program revision. Nearly 14 percent of the suggestions for course improvement 
involved staff preparation. Almost 10 percent of the ideas were in the area of improved linkages 
with business, industry, and labof. Improved evaluation methods were suggested m 6 percent of 
the cases and stronger administrative support in 5 percent of the cases. Table 12 contams the data 
on ideas for improvement. Interestingly, suggestions were not given for dealing with learner prob- 
lems, the most common type of problem reported. There appears to be a gap between the prob- 
lems encountered and the suggestions offered for course improvement. 



Descriptors of Competency-Based Courses 

Section I of the questionnaire contained 19 items which were identified m the literature as 
descriptors of competency based instruction. These items were divided into tvyo.categories-one 
describing the structure of the course, the other describing the terminal performance objectives. 
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Table 12 

Suggested' Ideas on Competency-Based Course Improvement 



Idea Category 


Number 


Percent 


Curriculum and program revision 


56 


47,9 


Updating materials and equipment 


21 


17,9 


Staff preparation 


16 


13.7 


Better links with business, industry, and labor 


11 


9.4 


Improved evaluation methods 


7 


^ 6.0 


Administrative support 


6 


5.1 


TOTALS 


V.7 


100.0 



The following discussion will focus.on the results of this rating o' courses by respondents on these 
descriptors. 

In Table 13 the categories of ratings for each of the 19 descriptors as well as the mean and 
standard deviation of the responses are indicated. A review of the table indicates that the descrip- 
tors "definitely" possessed by the largest number of respondents were items 1, 3, 4, 7, 10, 11, and 
18, These seven items appear to be basic descriptors for competency-based instruction, but are not 
foreign to other types of instruction. For example, item 18, "Objectives us^scribe the tasks to be ' 
learned," is often claimed as a feature of more traditional instruction. 

The descriptors unique to competency based instruction seem to be those which a relatively 
small percentage of courses definitely possessed. Items 2, 13 and 15 were those items which had 
the highest mean responses (indicating relatively small numbers of courses which "definitely pos- 
sess" the quality) on the de^riptors. These three items are characteristic of most competency- 
based instruction si/ice they represent a high degree of individualization of instruction, based on 
students' capabilities, needs, and learning styles. These findings suggest that many respondents are 
operating courses which are not completely competency-based. This statement is supported by 
other findings reported later in this chapter. 

The predictability or discriminability of these items for exemplary competency-based instruc- 
tion is discussed in a later section. 



Criteria for Competency-Based Adult Vocational Education 

Section III of the questionnaire contained six open ended items which asked respondents to 
describe in detail particular basic elements of their competency based courses. These s.x items 
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Table 13 

Percentage of Responses end Means of Ratings of Competency-Based Descriptors 

(n=^277l 



Does Not Possess, 
Oofinitely Somewhat Unusable, or Not Moan s.d. 
Possossos Possesses Applicable 
(1) (2) (3-) 



Structure of Course 












1. Learners are held responsible for meeting 
stated performance objectives 


234 
84.5% 


39 

14.1% 


4 

1.4% 


1.17 


.41 


2, Learners are pre*8ssessad upon entry*to determine 
learners' skills and objectives to be achieved, 
rather than all learners covering the same 
objectives 


92 

33.2% 


85 

30.7% 


100 
36.1% 


Z03 . 


.83 


3. Learners know the measures for which 
they are held accountable 


225 
81.2% 


. 47 
17.0% 


5 

1.8% 


1.21 


.45 


4. Instruction is segmented into manageable 
units, each containing related job skills 


231 
83.4% 


38 

13.7% 


8 

2.9% 


1.20 


.46 


5. Learners are responsible for achieving the 
competencies as opposed to clock hours 
of instruction * 


178 

64,3% 


69 

24.9% 


30 

10.8% 


1.47 


.68 


6. ^.earner performance is recorded as each 
objective is achieved 


195 
70.4% 


57 

20.6% 


25 
9.0% 


1.39 


.65 


7. Greater emphasis is placed upon exit require- 
ments (proficiency) than upon entrance re* 
ments 


222 
80.1% 


41 

14.8% 


14 

5.1% 


1.25 


.54 


8. Competencies are derived from a task or 
job analysis of the particular job 


198 
71.5% 


65 

23.5% 


14 

5.1% 


1.34 


.57 


9. Student assessment criteria are based upon 
competencies (i.e., ciiterion-refarenced 
testing is used) 


195 
70.4% 


54 

19.5% 


28 

10.1% 


1.40 


.67 


10. Continuous evaluation and feedback to 
the learner is provided 


225 
81.2% 


47 

17.0% 


5 

1.8% . 


1.21 


.45 


11. Individual learner competence is determined 
by individual learner performance 


83.8% 


38 

13.7% 


y 

2.5% 


1.i9 


.45 


12. Each learner \*j allowed to proceed to subse- 
quent instruction as quickly as performance 
objectives are attained 


172 
62.1% 


49 

17.7% 


56 

20.2% 


1.58 


.81 


13. Instruction offers learning alternatives for 
learners (i.e., different approaches) 


116 
41.9% 


112 
40.4% 


49 

17.7% 


1.76 


.73 


14. Instruction sp«:ifies media to be used 
to accomplish objectives 


192 
69.3% 


69 

24.9% 


18 

5.8% 


1.37 


.59 


15. If a learner does not achieve a learning task, a 

HlTTArAflt mafk#>#4 OT m«friif-f inn !* nmuirlfw^ /^r 

uiiiviviiL rnBinovi ui iroiiuwdun is piuviuou or 

suggested 


1 m 
41.2% 


lib 
. 41.9% 


47 

17.0% 


1.76 


.72 


Terminal Performance Objectives 












16. Objectives describe the conditions under 
which the learner will be expected to de* 
monstrate the level of competency 


188 

67.9% 


75 

27.1% 


14 
5.1% 


1.37 


.58 


17. Objectives describe the level of competency 
or standards (set by business nr industry) 
to be demonstrated 


196 
70.8% 


59 

21.3% 


22 
7.9% 


1.37 


c 

.63 


18. Objectives describe tiw tasks to be 
learned 


225 
81.2% 


46 

16.6% 


6 

2.2% 


1.21 


.46 


19. Objectives are structured in a sequential 
order or in order of task difficulty 


166 
59.9% 


78 

28.2% 


33 

11.9% 


1.52 


.70 



"Response categories 3 (Does Not Possess) and 4 (Unusable or Not Applicable) were combined since both collected, in effect, the 
same data. ' 
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were designed with the intent that appropriate, detailed descriptions offered by the respondents 
would be published in the National Directory of Selected Competency Based Adult Vocational 
Education Programs. These responses were content analyzed and assigned weights by project staff 
in terms of having strong (1 ), moderate (2), or weak (3) evidence of these competency based ele 
ments. Table 14 presents the distribution of these assigned weights. The element on which the 
courses were strongest was student testing. The courses were not exceptionally strong in any of 
the items, however. Som^, course descriptions received strong weights in each of th.. six areas. 
Those courses tended to surface as being the more exemplary. 

table 14 

Frequency Distributions of Weights Assigned 
to Competency-Based Criteria 



Weights Asrigned to Competency-Based Criteria 



Competency-Based Criteria 


Strong 
(1) 


Nioderate 
(2) 


Weak 
(3) 


Mean 


s.d. 


How were tasks identified in the job 
ahafysis? 


88 

34.0% 


127 . 
^<^.0% 


44 

17.0% 


1.84 


.69 


How were performance objectives developed 
and validated? 


99 

38.2% 


131 
50.6% 


29 

r..2% 


1.72 


.65 


How is instruction delivered? (For example, via 
modules, open entry/open exit, or other format) 


123 
47.5% 


100 
38.6% 


36 

13.9% 


1.66 


.70 


What is the nature of student testing? (For 
example, describe basis, methods, extent) 


155 
59.8% 


92 

35.5% 


12 

4.6% 


1.43 


.58 


What is the nature of course evaluation? 
(How reviewed, revised, who i^ involved, etc.) 


104 

40.2% 


103 
39.8% 


52 

20.1% 


1.81 


.75 


What is the nature of the support system of your 
instruction? (i.e., advisory groups, administration, 
funding base) 


93 

35.9% 


114 
44.0% 


52 

20.1% 


1.84 


.73 



Eighteen respondents did not complete this section of the questionnaire. 



A total score was computed by summirq the six weights assigned to each description. Courses 
with total scores from 6 9 were classified as "strong." Courses with scores from 10 13 were classi 
fied as "moderate," and those with scores from 14 17 were classified "weak." The distribution of 
the three groups is shown in Figure 3. The data indicate a substantial number of courses (42 per 
cent) were weighted as strong examples of competency based adult vocational instruction by the 
project staff. These proportions are particularly interesting when compared to a similar distribu 
tion of the total of the responjvcs to the 19 course descriptors in Section I. This comparison (shov\ri 
in Table 15) indicates that r^^spondents tended to rate their courses very highly. Weightings assigned 
by the project staff to descriptions written by respondents were noticeably weaker. Ratings in 
Section I were frequently poorly documented In Section III. However, the reader should keep in 
mind that Section I was designed for respondents to indicate the extent to which their courses 
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FIG. 3. 



Table 15 





Comparison of Respondents' Ratings with 
Project Staff Weightings 






Respondents' Ratings 


Project Staff Weightings 




Strong (1) 
(6.9) 


Moderate (2) 
/10.13) 


Weak (3) 
(14.17) 


Total 


Definitely Possesses (1) 
19-31 


94 


98 


25 


217 


Somewhat. Possesses (2) 
3244 


15 


16 


10 


41 


Does Not Possess (3) 
45.57 


0 


1 


0 


1 


TOTAL ' 


109 


115 


35 


259 



25 





DISTRIBUTION OF COMPETENCY-BASED CRITERIA TOTAL SCORE 

(n=259) 



vyere competency based using 19 descriptors. Section III was designed for respondents to describe" 
six basic features of their competency based courses. There is a distinction here which subsequent 
analyses performed between the two sections will illustrate.. 



Comparison of Private and Public Sectors 



Analyses were performed to determine if there were any differences between the public and 
. private sectors on selected variables in the study. These analyses will be discussed in this section. 



Advisory Councils 



Advisory councils were operated by respondents in both the private and public sectors. How- 
ever/ tliere was a substantial difference in the percentages between the two groups. These data are 
presented in Table 16. A chi square test indicates that the difference between these sectors is 
highly significant. Advisory councils were much more prevalent in the public sector than in the 
private sector, by a margin of J8 percent to 46 percent. This is understandable since public pro- 
grams, supported by public monies, must be accountable to a much broader constiuency than is 
true in the private sector. Advisory councils-may be used both to provide needed content input 
and also to make the courses more visible to the public. Private sector programs probably do not 
have this latter concern to as great a degree, and in this sector advisory councils apparently are 
used primarily for content input. 

Table 16 

Comparison of Private and Public Sectors' 
Use of Advisory Councils 
(n=277) 



Sector '^^ 



n % n ' % 



Private 36 46.2 42 53.8 

Public 155 77.9 44 22.1 

TOTAL 191 69.0 86 31.0 



Chi square = 24.90; df = 1; p <,000 



The membership of these councils also differs between the sectors. Table 17 indicates that 
there are significant differences between the private and public sectors on each of the types of re- 
presentation to the councils. Business, industry and school officials were common types of repre- 
sentatives in both sectors, but the public sector makes greater use of every member type except 
proprietary school officials. The probable reason for this exception is the substantial number of 
proprietary schools represented by private sector respondents. The greatest difference between 
the private and public sectors on this variable was the involvement of community leaders on ad- 
visory councils, with only one instance being reported in the private sector. 
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Table 17 



Comparison of Public and Private Sectors in Terms 
of Advisory Council Representatives 
(n=277) 



Typ^ss of 




Private 




Public 


Total 












n 


0/ 
70 


n 




n 


% 




df 


D 


Union 




5.1 


40 


20.1 


44 


15.9 


8.31 




.UUH 


Business 


15 


19.2 


117 


58.8 


132 


47.7 


33.59 




.000 


Industry 


24 


3G.B 


116 


58.3 


140 


50.5 


15.90 




.000 


University 


2 


2.6 


27 


13.6 


29 


10.5 


6.11 




.013 


College 


3 


3.8 


34 


17.1 


37 


13.4 


7.38 




.007 


School Officials 


17 


21.8 


114 


57.3 


131 


47.3 


26.91 




.000 


Community Leaders, 


1 


1.3 


82 


41.2 


83 


30.0 


4U.68 




.000 


Proprietary 
School Officials 


15 


19.2 


6 


3.0 


21 


7.6 


18.78 




.000 


Other 


13 


16.7 


38 


19.1 


51 


18.4 


.09 




.767 



^Frequencies represent onfy the affirmative (Yes) answers to the items.. 



Chi square (x ) tests should be interpreted with caution when there are fewer t»». n five cases in a cell. 



The reader should be aware that the significant chi square (x^) vai«es are a function of differ- 
ences between the frequency of yes/no responses for each "repraseiuative" category when divided 
into private and public sectors. 

Placement and Follow-Up 

Analyses v.8te performed on the survey items regarding the extent of placement and follow-up 
elements in their courses. Table 18 presents the comparison between private and public sectors in 
these areas. A review of this table indicates that there are no significant differences between the 
sectors on either of the two items. At first, this Is rather surprising since courses in the private sec- 
tor are usually viewed as primarily employee training in which placement and follow-up elements 
seem inappropriate. However, recalling previous data indicating that the private sector is represented 
heavily by proprietary schools, the non significance of the comparison becomes clearer. Private pro- 
prietary schoois are similar to public institutions in their need to place students and to study the 
effectiveness of their programs. 

Duration of Courses < 

The private/public sector comparison was extended to investigate any differences between the 
months. of the year during which courses operate. An analysis of the hours of instruction which 
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Table 10 

Comparison of Private and Public Sectors 
on Placement and Follow-up Programs 



Sector 



Yes 



% 



No 



% 



Other 



Private 
Public 
TOTAL 



48 

118 
166 



Chi square = .25; df = 2; p<.884 



Placement Program 
(n=274) 

61.5 19 24.4 
60.2 53 27.0 

60.6 72 76.3 



11 
25 
36 



14.1 
12.8 
13.1 



Private 
Public 
TOTAL 



59 
125 
184 



Follow-up Program 
(n=263) 

76.6 12 15.6 

67.2 46 24.7 

70.0 58 22.1 



6 
15 
21 



7.8 
8.1 
8.0 



Chi square = 2.76; df = 2; p <.251 



were required for learners to complete the respondents' courses showed a significant difference 
(t = 2.07; df - 164, p <.04) in the minimum hours required. The private sector showed a signif- 
icantly higher minimum number of hours required of their learners than the public sector. On 
the "average" number of hours and the maximum number of hours there were no significant 
differences between the two groups. 

There were significant chi square differences between the private and public sectors on the 
number of programs operating all year and for the months of September through May. The re 
suits of this analysis are shown in Table 19. 

The above differences are deceiving because one would expect the private sector to be less 
affected bv academic year schedules than the public sector. This supposition is well supported by 
the significantly higher number of private sector respondents who reported operating year round 
Thus, the monthly differences are an artifact of the data in that those respondents who indicated 
that they operate year round were not included in the "monthly" breakdown. The reader should 
note in the private sector that the frequencies of "yes" responses for the individual months are 
lower than the number of all year programs. Consequently, private sector respondents who opec 
ate year long are relatively insensitive to academic year schedules and summer vacations, whereas 



28 



ERLC 



. 39 



Table 19 

- Comparison of Public and Private Sectors 
^ Regarding Months of Course Operation 
{n=277) 



Months of 
Or .^'atibn 


Private 


Public 


Total 






df 




n 


% 


n 


% 


n 


% 




P 


AH Year 


58^ 


74.4 


93 


46.7 


151 


54.4 


16.15 




.000 


January 


20 


25.6 


92 


46.2 


112 


40.4 


9.03 




.003 


February 


16 


20.5 


97 


48.7 


113 


40.8 


17.34 




.000 


March 


19 


24.4 


100 


50.3 


119 


43.0 


14.29 




.000 


April 


16 


20.5 


97 


48.7 


113 


40.8 


17.34 




.000 


IVlay 


17 


21.8 


93 


46,7 


110 


3Q,7 


13.53 




.000 


June 


12 


15.4 


54 


27.1 


66 


23.S 


3.64 




.056 


July 


12 


15.4 


27 


13.6 


39 


14.1 


.04 




.842 


August 


6 


7.7 


24 


12.1 


30 


10.8 


.70 




.403 


September 


19 


24.4 


87 


43.7 


106 


38.3 


8.09 




.005 


October 


17 


21.8 


97 


48.7 


114 


41.2 


15.71 




.000 


November 


18 


23.1 


95 


47.7 


113 


40.8 


13.11 




.000 


December 


15 


19.2 


87 


43.7 


102 


36.8 


13.41 


I 


.000 



^Frequencies represent only those "Yes" answers to the items. 



those who operate periodically or on an academic year schedule appear to be affectea more by 
summer vacations of learners and instructors. 

Competency-Based Descriptors 

Responses to the 19 competency based descriptor items included in Section I of the survey 
for each sector are reported in Table^O. There are three descriptors (items 12, 1? and 15) which 
show significant differences between the private and public sectors. These items concern flexible 
scheduling and the provision of alternative learning approaches. On each of these items tpe private 
sector was less likely to possess the ciuality (low means are associated with "definitely possess"). 
A possible explanation for this phenomenon is that open entry/open exit scheduling and recycling 
might be more easily operated in a formal school setting, but arguments could be made that the 
opposite is the case. A more liKely explanation is that public educators are more in the forefront 
on these concepts than trainers in the private sector. 
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Table 20 

Comparison of Public and Private Sectors on the 
Ratings of Descriptors in Section I 
(n=277) 



Sector n Mean Standard 

Deviation 

1. Learners are held responsible for meeting stated performance objectives. 

Private 78 1.21 ,49 

Public 199 ' 1.16 .38 

t = .89; df = 275; p <.37^ 

2. Learners are pre-assessed upon entry to determine learners' skills and objectives to be achieved, rather than 
all learners covering the same objectives. 

Private 78 , 2.12 .81 

Public 199 2.00 .84 

t = 1.08; df= 275; p<.28 

3. Learners know the measures for which they are held accountable. 

Private 78 1.15 .43 

Public 199 1.23 .45 

t = -1.21; d^= 275; p<.23 



4. Instruction is segmented into manageable units, each containing related job skills. 

Private 78 1.19 .40 

Public 199 1.20 .49 

t = -.06;df = 275;p<.95 

5. Learners are responsible for achieving the competencies as opposed to clock hours of attendance. 
Private 78 1.55 ./6 
Public ' 199 1.43 .66 

t=1.31;df = 275;p<.19 

6. Learner performance is recorded as each objective is achieved. 

Private 78 1.42 .71 

Public 199 1.37 .62 

t=.59;df= 275;p<.56 

^Significance levels are for two tailed tests. 
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Table 20 • Continued 



Sector" n Mean Standard 

^ ' Deviation 

7. Greater emphasis is placed upon exit requirements (proficiency) than upon entrance requirements. 
Private 78 1.31 .59 
Public 199 1.23 .52 

t=1.14;df = 275;p<.26 

8. Competencies are derived from a task or job analysis of the particular job. 

Private 78 1.32 .57 

Public 199 1.34 .57 

t = %28;df = 275;p<.78 

9. Student assessment criteria are based upon competencies (i.e., criterion referenced testing is used). 
Private 78 1.29 .61 
Public 199 1.44 .69 

t=-1.60;df = 275;p<.11 

10. Continuous evaluation and feedback to the learner is provided. 

Private 78 1.14 .39 

Public 199 1.23 .47 

t = -1.51;df = 275;p<.13 

11. Individual learner competence is determined by individual learner performance. 

Private 78 1.18 .39/ 

Public 199 1.19 .48 

t = -.19;df = 275;p<.85 

12. Each learner is allowed tu proceed to subsequent instruction as quickly as performance objectives are attained. 
Private 78 1.90 .91 

Public 199 1.46 .73 

t - 4.21; df = 275; p<. 000 
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Table 20 • Continued 



Sector n Mean 




Standard 
Deviation 


13. instructioh offers learning alternatives for learners (i.e., different approaches). 






Privatp 78 2 03 




.76 


. Public 199 N 1.65 




.70 


t = 3.89; df = 275; p<.000 






14. Instruction specifies media to be used to accomplish objectives. 






rllVdic /O 1 .O^ 




.57 


Public 199 1.38 




.60 


t = -.78;df = 275;p<.44 






15. If a learner does not achieve a learning task, a different method of instruction 


s provided or suggested. 


Private 78 1.96 




.73 


Public 199 1.68 




.71 


t = 2.97; df= 275; p<.003 






16. Objectives describe the conditions under t^hich the learner «^ill be expected to demonstrate the level of 


competency. 






Priv.-'.te 78 1.31 




.61 


Public 199 1.40 




.57 


t = -1.15;df = 275;p<.25 






17. Objectives describe the level of competency or standards (set by business or industry) to be demonstrated. 


Private 78 1.33 




.64 


Public 199 1.39 




.62 


t '•.64;df = 275;p<.52 






18. Objectives describe the tasks to be learned. 






Private 78 1.14 




.42 


Public 199 1.2!4 




.47 


t = -1.56;df = 275;p<.12 






19. Objectives are structured in a sequential order or in order of task difficulty. 






Private 78 1.58 




.73 


Public 199 1.50 




.69 


t=.85;df=275;p<.40 
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Competency-Based Criterion 

Section III of the questionnaire included six open ended questions for respondents to describe 
components of their courses. The strategy behind these criterion questions has been discussed pre- 
viously. The results of the scoring of these criterion items for the two sectors are displayed in 
Table 21. 

A review of this table shows that there was only one significant difference between the sectori. 
The private sector respondents displayed significantly weaker ratings on the item of instructional 
delivery. This finding supports the differences displayed by the competency-based descriptors. 
Private sector respondents reported less flexibility in operating open entry /open exit programs, thus 
reducing the options available to the learner for progressing through a course or program of study. 

No other significant differences were found between the two sectors on these competency- 
based criterion questions. The inclusion of proprietary schools in the private sector, as discussed 
earlier, may have caused more similarities between the sectors than if proprietary schools had not 
been included. 



Descriptor Score Comparisons with Other Variables 

As discussed earlier, the 19 competency based descriptors (Section I) were summed to form a 
total score for each respondent. This score was then divided into three categories to be indicative 
of the degree to which courses may be characterized by those descriptors. The categories were, 
definitely possess the descriptors (total = 19 31), somewhat possess the descriptors (total = 32-44), 
and does not possess the descriptors (total = 45-57),^ Several of the items in the survey were com- 
pared-with this three category variable to determine whether any differences existed among these 
items and the levels of strength of course descriptors. These comparisons will be discussed in some 
detail in this section. 

Advisory Councils f 

The comparison between the de^scriptor total from Section I of the questionnaire and the pos 
session of an advisory council is presented in Table 22. A review of this table indicates there is a 
significant positive relationship between the possession of an active advisory council and the ten- 
dency to definitely possess the descriptors of competency based instruction. This finding is not 
surprising since advisory council functions are frequently involved in executing many of the de- 
scriptors. For e sample, using task or job analyses, determining conditions under which competen- 
cies are demonstrated, and so on, can be greatly enhanced by inputs of an advitory council. 

An analysis was performed to in\.estigate relationships between the descriptor totals and the 
types of members of advisory councils. The findings of these analyses are reported in Table 23 in 
which a significant difference exists between the descriptor totals and advisory council members 
representing business and Industry. Those programs which rate high on the descriptors tend to 
have business and industry members to a significantly greater degree than those with lower ratings. 



The reader may recall the fourth rating category provided in the questionnaire, "4 = unusable 
or not applicable." This category was combined with the "3 = does not pcssess" category smce 
they both collected, in effect, the same data. 
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Table 21 

Comparison of Public and Private Sectors-on the 
Weights Assigned to Criteria in Section III 



Sector 



Mean 



Standard 
Deviation 



Private 
Public 

t«.61;df «275;p<.55 



Method for Identification of Tasks 



78 
199 



1.95 
1.89 



.72 
.74 



Private 
Public 

t = -.64; df = 275;p<.52 



Development of Performance Objectives 

78 1.77 
199 1.83 



,72 
.70 



Private 
Public 

t = 4.q5;df = 275;p<.000 



Instructional Delivery 



78 
199 



2.04 
1.64 



.69 
.76 



Private 
Public " 

t=1.05;df = 275;p<.31 



Student Testing Procedures 

78 ' 1,62 
199 1.52 



.65 
.70 



Private 
Public 

t = .61;df = 275;p<.54 



78 
199 



Course Evaluation 



1.92 
1.86 



.72 
.81 



Private 
Public 

t = 1.31;df= 275;p<.19 



Support System 

78 2.01 
199 1.88 



.90 
.70 



/ 
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Table 22 

Comparisons Among Levels of Descriptor Totals 
and Operation of an Active Advisory Council 



Descriptor 
Total Score 
Categories 



Yes 



Active Advisory Council? 



% 



No 



% 



Definitely possesses (1) 
(19-31) 

Somevi.rhat possesses (2) 
(3244) 

Does Not Possess (3) 
(45-57) 

TOTAL 



164 
27 
0 
191 



71.9 
57.4 
0.0 
69.9 



64 
20 
2 
86 



28.1 
42.6 
100.0 
31.0 



Tau = .10;p<.009 



Table 23 

' Comparison of Descriptor Total Levels and 
Advisory Council Member Types 
(n=277) 



Types of 
Representatives 



Descriptor Total Score Categories 



Definitely 
Possesses 

(1) 
(19-31) 



Somewhat 
Possesses 
(2) 
(32-44) 



Does Not Possess, 
Unusable 
(3) 
(45-57) 



df 





n 


% 


n 


% 


n 


% 






Union 


37^ 


16.2 


7 


14.9 


0 


0.0 


,11^ 1 


.80 


Business 


117 


51.3 


15 


31.9 


0 


0.0 


5.68 1 


.02 


Industry 


124 


54.4 


16 


34.0 


0 


0.0 


6.25 1 


.02 


University 


24 


10.5 


5 


10.6 


0 


0.0 


.01 1 


.99 


College 


32 


14.0 


5 


10.6 


0 


0.0 


.42 1 


.70 


School Officials 


114 


50.0 


17 


36.2 


0 


0.0 


3.79 1 


.10 


Community Leaders 


69 


30.3 


14 


29.8 


0 


0.0 


.06 1 


.80 


Proprietary School 
Officials 


21 


9.2 


/ 

0^ 


0,0 


0 


0.0 


4.88 1 


.05 


Other 


43 


18.9 


8 


17.0 


0 


b.o 


.17 1 


.80 



^Frequencies represent only the "Yes" answers to the items. 

Categories {2) and (3) were combined to compute the chi square statistics. 
''Chi squares computed when a cell frequency is less than 5 should be interpreted with caution. 
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It is also noteworthy that reported involvement of proprietary school officials are all associated 
with the "definitely possesses" category. This is further evidence that much of the strength of 
competency -based instruction in the private sector, in the few instances found, is attributable in 
large part to proprietary schools. 

Placement and Follow-Up ^ 

\ 

The placement and follow up elemerits for each level of descriptor totals are illustrated in 
Tablet 24. A review of this table shows a significant difference between the possession of placement 
and follow-up elements and high ratings on the descriptors. As wac the case with advisory councils, 
neither of these, eleir.ents are unique to competency based courses or programs but can be possessed 
by all types of vocational education. However, this finding indicates that the stronger competency 
based courses tend to possess these elements. A pattern emerging from the data is that relatively 
strong competency based instruction is associated with the more widely accepted practices of ad 
visory council use, placement programs and follow up activities. These practices are all appearing 
as indicators of program quality. However, the data do not permit cause and effect inferences to 
be made. 




Table 24 

Comparison of Descriptor Total Levels with 
Placement and Follow-up Activities 



Descriptor 
Total Score 
Categories 


Yes 




No 




Other 




n 


% 


n 


% 


n 


% 








Placement Program 
(n=274) 








Definitely Possesses 


148 


65.5 


50 


22.1 


28 


12.4 


Somewhat Possesses 


18 


39.1 


20 


43.5 


8 


17.4 


Does Not Possess 


0 


0.0 


2 


100.0 


0 


0.0 


TOTAL 


166 


60.6 


72 


26.3 


36 


13.1 


14.19; df = 2;p<.001 
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Follow-Up 
(n=263) 



Definitely Possesses 


159 


72.9 


41 


18.8 


18' 


8.3 


Somewhat Possesses 


24 


55.8 


16 


37.2 


3 


7.0 


Does Not Possess 


1 


50.0 


1 


50.0 


0 


0.0 


TOTAL 


184 


70.0 


58 


^ 22.1 


21 


8.0 



X 



2=7.88';df=2;p<.02 



'"Somewhat Possesses" and Does Not Possess" Cdtegones were combined to compute the chi square statistic 
due to some small cell sizes. 
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Months of Operation 

i ' 

When the months that courses operated were compared with the descriptor totals, se\/eral sig- 
nificant relationships were found. These analyses are displayed in Table 25. There is a highly sig- 
nificant difference between the levels of the descriptors and courses operating ail year. The avail 
ability of full time staff operating all year to develop or improve courses may be a consideration. 
However, another explanation may be that the concepts related to competency based instruction 
such as open entry/open exit and individualization ar^ especially compatible with the year round 
school concept. There are also significant differences between descriptor total lf,vels and certain 
months of the year. However, there appears to be no discernable pattern to these results. 

Table 25 

Comparison of Months During Which Courses ^ 
Operate and Descriptor Total Scores » 
(n=277) 



Descriptor Total Score Categories 



Month(s) 
Offered 


Definitely 
Possesses 

(1) 


Somewhat 
Possesses 
(2) 


Does Not 
Possess 
(31 


x2 


\ 

df 


P 




n 


% 


n 


% 


n 


% 








All Year 


136^ 


59.6 


15 


31.9 


0 


0.0 


13.71^ 




.001 


January 


84 


36.8 


27 


57.4 


1 


50.0 


6.90 




.01 


February 


89 


39.0 


24 


51.1 


0 


0.0 


1.65 




.20 


March 


91 


39.9 


27 


57.4 


1 


50.0 


4.89 




.05 


April 


87 


38,2 


25 


53.2 


1 


50.0 


3.71 




.10 


May 


83 


36.4 


26 


53.3 


1 


50.0 


5.89 




.02 


June 


53 


23.2 


13 


27.7 


0 


0.0 


.24 




.70 


July 


30 


13.2 


7 


14.9 


2 


100.0 


.91 




.50 


August 


25 


11.^ 


5 


10.6 


0 


0.0 


.02 




.90 


September 


80 


35.1 


26 


55.3 


0 


0.0 


5.52 




.02 


October 


86 


37.7 


26 


55.3 


2 


100.0 


6.28 




.02 


November 


86 


37.7 


27 


57.4 


0 


0.0 


5.05 




.05 


December 


79 


34.6 


23 


48.9 


0 


0.0 


2.62 




.20 



Scores represent only those "Yes" answers to the iiems. 

Categories (2) and (3) were combined to compute the chi square statistics due to some small cell sizes. 
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Regression and Canonical Correlation Analyses 



Two analyses were performed to determine the degree of relationship between the 19 course 
descriptors from Section I and the six criterion items from Section III. The first analysis was a linear 
regression in which the dependent variable (criterion) was the sum of the six criterion items. The 
independent variables were the 19 course descriptor variables. The secofJ analysis was a canonical 
correlation analysis which related the six criterion items to the 19 course descriptor variables. 

Table 26 shows the correlation of each of the 19 course descriptor variables with the criterion 
variable, the total of the six criterion items. Descriptor Item 2, "Learners are pre-assessed upon 
entry to determine learners skills and objectives to be achieved, rather than all learners covering the 
same objectives," is the most strongly related with, the extent to which a course is competency based. 
Thus, courses in which learners are pre assessed to determine learner skills jnd objectives to be 
achieved are more likely to be strongly competency based than courses in which Larners are not 
pre-assessed. Other descriptors which are somewhat related to the criterion in descending order of 
strength are: 

4. Instruction is segmented into manageable units, each containing related job skills. 

12. Each learner is allowed to proceed to subsequent instruction as quickly as performance 
objectives are attained. 

6. Learner performance is recorded as each objective is achieved. 

7. Greater er phasis is placed upon exit requirements (proficiency) than upon entrance 
requirements. 

9. Student assessment criteria are based upon competencies (i.e., criterion referenced 
testing is used). 

All 19 descriptors were positively related to the criterion, indicating that for all the course de 
scriptor Items, a course which has the characteristic described by the item is more likely to be com 
petency-based than one which does not have the characteristic. It must be remembered, however, 
that all but a few of the relationships are very. weak. The low correlations are due in part to the dis 
crepancy between the relatively high ratings of courses by respondents in Section I and the more 
moderate weights assigned by project staff to open ended responses in Section III. 

When all 19 course descriptor variables are included in a regression equation predicting the 
extent to which a course is competency based, 14 percent of the variation in the extent to which a 
course is competency-based can be explained by the course descriptor variables. This leaves 86 
percent of the variance to be explained by other variables which were not included in the equation, 
including respondent error (e.g., over rating). These data indicate that the relationship is not strong 
although it is statistically significant. Items 2, 4 aad 12 are most responsible for the relationship 
since a regression equation including only those three variables accounts for 10 percent of the varia 
tion in the competency-based total. 

The standardized regression coefficients are also shown in Table 26. In general, the variables 
which are most strongly correlated with the criterion have the larges* oefficients. Since all the 
variables are positively correlated with the criterion, the negative coefficients are due to the cor 
relations among the predictors rather than inverse relationships with the criterion. 
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Table 26 

Correlations of Ratings on Descriptors with 
Assigned Weights on Competency-Based Criteria 



Critoria fi'om Soction III 



Descriptors from Section I 




1 . Learners are held responsible for meeting stated 

performance objectives 

■i 

2. Learners are pre>assessed upon entry to determine 
learners' skills and objectives to be achieved, rather 
tf^an all learners covering the same objectives 

3. Learners know the measures for which they are 
held accountable 

4. Instruction issegmented into manageable units, 
each containing related job skills 

5. * Learners are responsible for achieving the competencies 

as opposed to clock hours of attendance 

6. Learner performance is recorded as each objective is 
achieved 

7. Greater emphasis is placed upon exit requirements 
(proficiency) than upon entrance requirements 

8. Competencies are derived from a task or job analysis 
of th"* particular job 

9. Student assessment criteria are based upon competencies 
(i.e., criterion>referenced testing is used) 

10. Continuous evaluation and feedback to the learner 
is provided 

11. Individual learner competence is determined by 
individual learner performance 

1 2. Each learner is allowed to proceed to subsequent 
instruction as quickly as performance objectives 
are attained * 

13. Instruction offers learning alternatives for los^rncrs 
(i.e., different epproachesi 

1 4. I nstruction specifies media to bo used to acccm^jlish 
objectives ' 

15. If a learner doe^ ncu achieve a learning task, a different 
method of instruction is provided or suggested 

16. Objectives describe the conditions under which the 
learner will be expected to demonstrate the level of 
competency 

17. Objectives describe the level of competency or standards 
(set by business or industry) to be demonstrated 

18. Objectives describe the tasks to be learned 

19. Objectives are structured in a sequential order or in 
order of task difficulty 



.18* 



.15* 



.24» 



.24* 



,7Z** .14* * .15* 

.17»* .I5» 
M** .14* 

.17** .14* 

.2r* .18»» 

.14* J7»» 



.21* 

.19* 

.17* 
.17* 

.13* 



AS** .23*» .13* 



At* 



.16* .19** 



.14* 



.11 

.17 
-.06 
.19 
.03 
.08 
.09 
-.03 
.03 
-.01 
..11 

.14 
-.01 
%01 

.06 

..01 

..01 
.06 

-.08 



^Non-significant correlations were not reported. Pearson r reported with df = 243. 

*p<.05 

♦*p<.01 
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In summary, there is a relatively weak relationship between the course descriptor variables 
and the extent to which a course is competency based. Items most strongly related to the criterion 
are: 

2. Learners are pre-assessed to determine skills and objectives. 

4. Instruction is segmented into manageable units. 

12. Each learner is allowed to proceed as soon as objectives are attained. 

In the canonical correlation analysis, all six competency-based criterion variables serve as 
criteria or dependent variables. As in the regression analysis, the 19 course descriptors are the inde- 
pendent variables. The eigenvalues, canonical correlations, and chi square tests of significance a.e 
shown in Table 27. These data show that there is only one significant dimension in this relationship. 
The canonical correlation equals .51 . This is the correlation between two new composite (canonical) 
variables, one comprised of the 19 descriptors and the other comprised of the six criterion qt;est!ons. 
These two variables were formed to make as strong a relationship as possible between the two sets 
of variables. 

Table 27 

Canonical Correlations and 
Tests of Significance 



Step 


Eigenvalue 


Canonical 
Correlation 


x2 


df 


P 


1 


.26 


.51 


130.7 


90 


.003 


2 


.24 


.49 


66.6 


68 


.525 


3 


.12 


.35 


36.5 


48 


.888 


4 


.10 


.31 


12.6 


30 


.998 


5 


.03 


.18 


5.2 


14 


.983 


6 


.02 


.15 









To interpret this relationship, a number of correlation coefficients were computed, ^ach de- 
scriptor variable was correlated with the composite variable formed from the 19 descriptor variables, 
and^each criterion variable was correlated with the composite variable formed from the six criterion 
variables. If a correlation is relatively high (>.3), the variable is important in the relationship be 
tween the descriptor and criterion variables. These correlations, called th3 factor structure, are 
shown in Table 28 for the one significant dimension in the relationship. 

A profile of competency based courses can be described from the correlations in Table 28. 
These correlations Indicate that the strongest relationship between the two sets of variables is 
characterized by courses which are competency-based in: 
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Table 28 

Correlation of Original Variables with Canonical Variable 



Descriptors 



Factor 

Structure 

Correlations 



Criterion 
Questions 



Factor 

Structure 

Correlations 



1. Learners are held responsible for meeting 

slated performance objdctives .25 

2. Learners are pre*as$essed upon entry to determine 
learners' skills and objectives to'be.achieved, rather 

than all learners covering the same objectives .40 

3. Learners know the measures for which they 

are held accountable .01 

4. Instruction is segmented into manageable units, 

each containing related job skills ••lO 

5. Learners are responsible for achieving the compe* 

tencies as opposed to clock hours of attendance .36 

o. Learner performance is recorded as each objective 

is achieved .34 

7. Greater emphasis Is placed upon exit requirements 
(proficiency) than upon entrance requirements .25 

8. Competencies are derived from a task or lOb 

analysis of the particular job sSl 

9. Student assessment criteria are based upon compe- 
tencies (i.e., criterion-referenced testing is used) .14 

10. Continuous evaluation and feedback to the 

learner is provided .17 

11. individual learner competence is determined by 
individual learner performance .13 

12. Each learner is allowed to proceed to subsequent 
instruction as quickly as performance objectives 

are attained .65 

13. Instruction offers learning alternatives for 

learners (i.e., different approaches) .14 

14. Instruction specifies media to be used to 

accomplish objectives ••20 

15. If a learner does not achieve a learning task, 
a different method of instruction is provided 

or suggested .24 

16. Objectives describe the conditions under which 
the learner will be expected to demonstrate the 

level of competency ^.lO 

17. Objectives describe the level of competency or 
standards (set by business or industry) to be 
demonstrated .28 

18. Objectives describe the tasks to be learned '.16 

19. Objectives are structured in a sequential order 

or in order of task difficulty •.08 



1. How wore tasks identified in 

the job analysis? %10 

2. How were performance 
objectives developed and 

validated? .06 

3. How is instruction 

delivered? .84 

4. What is the nature of 

student testing? .49 

5. What is the nature of course 
evaluation? .37 

6. What is the nature of the support 

system of your instruction? .13 
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• The way instruction is delivered (e.g., via modules, open entry/open exit). 

• The nature of student testing (i.e., use of criterion-referenced testing). 

• The nature of course evaluation (especidlly, continuous monitoring of learner performance 
and systematic follow-up of course completers). 

• Allowing learners to proceed as quickly as performance objectives are attained. 

• Pre-assessing learners upon entry to determine their skills and objectives to be achieved. 

• Requiring achievement of competencies rather than clock hours of attendance. 

• Recording learner performance as each objective is achieved. 

• Not deriving competencies from a task or job analysis. 

The negative relationship indicated for this latter item is probably due to the more common use of 
advisory councils to derive competencies, rather than the use of a formal task or job analysis. Nearly 
all respondents who presented evidence of using a task or jqb analysis to derive competencies were 
using V-TECS catalogs. These catalogs were explained in Chapter I of this report. 

Thus, the canonical .correlation analysis shows that three of the six competency-based criterion 
variables were most important in the relationship between the two sets of variables. The course de 
scriptor variables which were important in the linear regression were, for the most part, the ones 
which were important in the relationship described by the canonical correlation. 

In drawing conclusions from these results it must be remembered that only courses which re 
spondents considered to be competency based were included in the sample. If courses not con 
sideted competency based had also been included, the relationship would probably have been 
stronger, and different ariables may have proved important in describing the relationship. 
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CHAPTER IV 



SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 



The major question investigated in this survey was. What are the characterisf^.s of specific 
competency based adult vocational programs in both the public and ;.rivate sectors? Some valuable 
information regarding these characteristics was delineated in Chapter III. 

/ 

Before presenting specific conclusions and recomnjendations, it may be helpful to summarize 
the findings of the sjrvey. Following the summary of findings, ccr.Jusions and recommendations 
will be presented. / 

/ 

/a 

Summary of Findings 

Questionnaires were sent to 1,657 potential respondents and, after a mail follow-up and a 
telephone follow up, 277 usable returns were received. Approximately 72 percent of the returns 
were from the public sector and 28 percent from the private sector. A majority of the responses 
of the private sector were from proprietary schools. 

Demographic Characteristics 

A majority (53 percent) of the competency based adult vocational courses identified were in 
the trade and industrial education area. Approximately 22 percent of the courses were in the busi- 
ness and office education area, and almost 12 percent were in the health occupations area. Very 
small percentages of the courses were found in distributive education, home economics, and agn- 
cultural education. Most courses were reported as being in the vicinity of 140-180 hours in length, 
while 80 of the respondents {29 oercent) reported that their programs were completely open eniry/ 
open exit. Over half of the courses were offered all year. 

The median number of job competencies (tasks) identified for courses was reported to le ap- 
proximately 31, and approximately 23 was the median number of terminal perfor.T.^nce objectives 
reported, based upon competencies Identified for the courses. 

The majority of the adult vocational courses reported had both female and male en,ollments. 
The median number of females enrolled was approximately 16, and the median number of males 
enrolled was approximately 22. 

Advisory councils were reported in use by 69 percent of the respondents, 60 percent reported 
t^at placement programs were being used, and 70 percent reported that they employ a follow-up 
system for course completers. The predominant types ot members on advisory committees con- 
sisted of industry representatives, business representatives, school officials, and community leaders, 
in that order. 
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Regarding facilities in which courses.were offered, approximately 16 percent were offered in 
proprietary schools, over 15'percent were offered in both adult skill centers anu m public technical 
institutes, over 12 percent were offered in public secondary schools, and over 1 1 percent were of 
fered in junior or community colleges. Business and industry combined offered over 12 percent of 
the courses reported. 

Problems and Ideas for Improvement 

Respondents mentioned a number of problems they had experienced in developing and oper 
ating competency based courses. Learner problems, namely, low ability and lack of qualifications, 
were mo-t frequently mentioned. Keeping the curriculum up to date was the next most common 
problem, followed by administrative and organizational difficulties. The Ideas most commonly 
given by respondents for improving their competency based courses dealt with curriculum and 
program revision, updating materials and equipment, and improved staff preparation. 

Course Descriptors 

Regarding the 19 descriptors of competency bosed courses, there were seven descriptors which 
were "defini.tely possessed" by a relatively large number of respondents' courses. Inspection of 
those seven descriptors suggested that they may be relatively easier to implement or to claim as a 
course attribute than several of the other descriptors. The other descriptors that may be viewed 
as more unique to competency based instruction were "definitely possessed" by a relatively small 
percentage of courses. These more unique items dealt with ( 1 ) pre assessment of learners upon 
entry to determine their skills and objectives to be achieved, rather than all learners covering the 
same objectives, (2) instruction offering learning alternatives for learners-different approaches, 
and (3) providing or suggesting a different method of instruction if a learner does not achieve a 
learning task. The above items appear crucial to most competency based instructiori since they re 
present a high degree of individualization of instruction, based on student capabilities, needs, and 
learning styles. The findings suggest that many respondents are operating courses which are not 
completely competency-based. 

Open-Ended Questions 

The six open-ended criterion questions for competency based adult vocational instruction 
revealed that student testing was the area of greatest strength among the courses. However, con 
sidering ail responses as a group, courses were not exceptionally strong on any of ths six questions. 
Based on the weights assigned by project staff to these open ended responses, 42 percent of the 
courses were rated as "strong," over 44 percent were rated as "moderate," and almost 14 percent 
were rated as "weak" in terms of evidence presented to document the degree to which courses 
were competency-based. 

Overall, respondents rated their courses on the 19 descriptors much higher than the project 
staff weighted the six open ended responses. Further, evidence provided by the respondents for 
the open ended questions irequently contradicted or failed to support the ratings claimed by re 
spondents on many of the 19 descriptors. Social desirability may have been operating as respon 
dents rated their courses. Some respondents perhaps did not know the meaning of competency 
based instruction. 

Comparison of Public and Private Sectors 

Advisory councils were in use with over 75 percent of the courses reported from the public 
sector and in almost half of the courses reported from the private sector. The sectors were 
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significantly different on this variable. Advisory councils in the private sector are apparently used 
primarily for content input. Also, the public sector made greater use of a wider variety of members 
than was true In the private sector. 

Somewhat surprisingly, the private sector and public sector made almost equal use of botji 
placement programs and follow up programs. This may have been due to the relatively large pf;o 
portion of proprietary schools in the private sector, which could have tended to equalize differences 
between the sectors. That is, proprietary schools may operate their courses more like public insti 
tutipns that do business, industry and labor training establishments. 

The hours required to complete courses were similar between sectors except for the minimum 
hourly requirements in the public sector, which were significantly less than in the private sector. 
Almost three fourths of the courses in the private sector were offered year round, whereas lesb than 
half of the courses in the public sector were offered year round. This difference was highly signif 
icant statistically. Further, year round operation was associated with relatively strong competency 
based adult vocational instruction in both sectors. 

The public and private sectors differed significantly on three of the descriptors. One descrip- 
tor concerned flexible scheduling and the other two concerned provision of alternative learning ap 
preaches. On each of the three descriptors, the private sector was less likely to possess the descrip 
tor than the public sector. It appears that the public sector is more in the forefront on the^e 
concepts than trainers in the private sector. Regarding differences in responses to the six open 
ended criterion questions, one significant difference was found. Public sector respondents received 
significantly stronger ratings on the question regarding instructional delivery. Respondents in the 
private sector indicated less flexibility m ope.ating open entry/open exit programs, thus reducing 
the options available to learners. The consistency of firi 'ings reported in this paragraph are note- 
worth y. 

Descriptor Comparisons with Other Variables 

Courses which definitely possessed high proportions of the 19 descriptors were more likely to 
have an active advisory council than courses possessing the descriptors to a lesser extent. This 
finding is r.ot surprising since advisory councils frequently are involved in implementing the con 
cepts underlying the competency based descriptors. Further, competency based courses which are 
rated high on the descriptors also tend to have a larger proportion of business and industry mem 
beiS on their advisory councils. Also, m the private sector, the use of proprietary school officials 
on advisory councils is associated with courses which definitely possess the 19 descriptors. 

Courses which were rated high on the descriptors also tended to have placement and follow- 
up activities. Stronger competency based courses tend to possess these elements. 

Courses which definitely possess the 19 descriptors also have a strong tendency to be in opera 
tion year round. Competency based concepts of open entry/open exit and individualization of in 
struction are especially compatible with year-round schools. 

Regression Analysis and Canonical Correlation 

A linear regression was performed in which the 19 course descriptors were the independent 
variables and the suni of six weights on the open ended questions the dependent (criterion) van 
able. The descriptors which were most related to the criterion, in descending order of strength, 
were: 
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• Learners are pre assessed upon entry to determine learners' skills and objectives to be 
achieved, rather than all learners covering the same objectives; 

• Instruction is segmented into manageable units, each containing related job skills, 

• Each learner is allowed to proceed to subsequent instruction as quickly as performance 
objectives are attained; 

• Learner performance is recorded as each objective is achieved; 

• Greater emphasis is placed upon exit requirements (proficiency) than upon entrance 
requirements; and 

• Student assessment criteria are based upon competencies (i.e., criterion referenced testing 
is used). 

However, all of these relationships were relatively weak. The 19 descriptors accounted for 14 
percent of the variance in the criterion, leaving 86 percent of the variance unexplained. It is be 
lieved that respondent error (e.g., over rating) was in part responsible for the unexplained variance. 

The canonical correlation analysis indicated that courses which are competency based in their 
means of delivering instruction and by the nature of student testing and course evaluation, are also 
characterized by allowing learners to proceed as quickly as objectives are attained, pre assessing 
learners upon entry, not requiring clock hours of attendance, and recording learner performance 
as each objective is achieved, but not deriving competencies from a task or job analysis. For the 
most part, course descriptors which were important in the linear regression were also important in 
the canonical correlation analysis. In drawing conclusions from these results, one must remember 
that only courses considered to be competency based were reported. If courses not considered 
competency based had also been included, the relationship would probably have been stronger. 
Thus, the select nature of the sample tended to restrict the range of variability. 



^ Conclusions 

Conclusions will now be presented based upon the findings previously reported. The conclu 
sionsare as follows: 

1. Relatively few. high quality competency based adult vocational education programs exist. 
There are a few excellent examples which were identified in the national survey, but 
compared to the overall scope of adult vocational education, competency based courses 
are minuscule. Since only 60 of the 277 responses were judged adequate for inclusion 

in the National Directory, this conclusion seems particularly well documented. 

2. Regarding the type, of courses identified, competency based courses for adults in dis 
tributive education, home economics, and agricultural education are almost non existent 
compared to the number identified in the trade and industrial education area. 

3. Far too many of the courses reported in the survey (71 percent) operate on schedules 

in which time is held constant, in these instances performance must have a wide range of 
acceptability for adult learners. Fewer than one third of the competency based courses 
reported possess the open entry/open exit feature in which performance is held constant 
and time is varied. 
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4. Relatively strong competency based adult vocational instruction is associated with the 
use of advisory councils, placement programs^ follow up programs, and year round oper 
ation. These features seem to be indicators of program quality. 

5. Persons who operate competency based adult vocational courses need assistance in coping 
with divergent student populations, keeping curricula up to date, and management of 
administrative and organizational concerns according to perceptions of respondents. 

6. Among the 19 competency based course descriptors, the various analyses performed 
suggest that the following descriptors are especially important in effective competency- 
based adult vocational instruction: 

• Learners are pre-assesseu upon entry to determine learners' skills and objectives 
to be achieved, rather than all learners covering the same objectives. 

• Instruction is segmented into manageable units, each containing related job skills. 

• Each learner is allowed to proceed to subsequent instruction as quickly as perfor- 
mance objectives are attained. 

• Instruction offers learning alternatives for learners (i.e., different approaches). 

• If a learner does not achieve a learning task, a different method of instruction is 
provided or suggested. 

• Learner performance is recorded as each objectiye is auWeved. 

• Greater emphasis is placed upon exit requirement (proficiency) than upon entrance 
requirements. \ 

\ 

• . Student assessment criteria are based upon competencies (i.e., criterion-referenced 

testing is used). 

These items were most frequently assigned course ratings of does not possess, unusable, 
or not applicable. Thus, only the strongest competency based adult vocational courses 
possessed these descriptors to a substantial degree. 

7. Evidence provided in response to the open ended questions suggests that criterion 
referenced testing, or at least some type of performance testing, is in use by niost 
respondents. 

8. Public sector competency based adult vocational programs appear superior to private 
sector programs in the following areas: 

• Use of advisory councils 

• Diversity of advisory council input 

« Possession of the following course descriptors: 

a. Each learner is allowed to proceed to subsequent instruction as quickly as 
performance objectives are attained. 
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b. Instruction offers learning alternatives for learners (i.e., different approaches). 

c. If a learner does not achieve a learning task, a different method of instruction 
is provided or suggested. 

• Instructional deliver\{ via modules, open entry/open exit, and so on. 

However, as has been discussed, the need for advisory council inputs in private sector 
instruction is probably less than in the public sector. 

9. Private sector competency based adult vocational program§.are superior to public sector 
programs in year round operation by an approximate 75 percent to 50 percent margin. 
However, the finding that almost half of the competency-based adult vocational courses 
in the public sector are offered year-round is a positive indicator. 



Recommendations 

Recommendations will be presented here based upon the evidence and conclusions presented 
in this report. The recommendations are: 

1. A large scale effort to disseminate information on the state-of-the-art in the most exem- 
Dlary competency based courses identified in this survey should be initiated by profes- 
sionals and their professional associations. Federal support would be highly desirable. 
However, state and local leaders, educators and trainers, and associations should not 
wait for someone else to take the initiative in this effort. Site visits, materials exchanges, 
in service workshops, and various types of consultation and technical assistance need to ' 
be provided to enhance the rate of acceptance of competency-based concepts in adult 
vocational education. * 

2. Leaders in distributive education, home economics, and agricultural education need to 
make a special effort to initiate competency based demonstration programs to a level at 
least comparable in size to that in trade and industrial education. However, on a national 
scale, there needs to be a dramatic increase in the number of competency-based courses 
in all major occupational areas. Models have been identified in this project which can 
serve as guides to implementation of this recommendation to enhance the delivery sys- 
tems in adult vocational instruction. 

3. Greater emphasis must be placed on the development of open entry/open exit compe- 
tency based adult courses. It has been demonstrated from evidence in this study that 
the open entry/open exit concept can be applied in virtually all institutional settings. 

4. Leaders in adult vocational education should continue to emphasize and implement the 
concepts of advisory councils, placement programs, follow-up programs, and year-round 
program operation as means of enhancing the quality of competency-based courses. 

5. Varied in service staff activities need to be designed to assist instructors with handling 
student diversity, updating curricula, and overcoming administrative and organizational 
constraints in the operacion of competency based adult vocational courses. Assistance 
should also be provided in these areas by paraprofessicnal aides, curriculum developers, 
and state and local administrators. 
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6. In order lo slrcnglhcn oxi/liny cornpulcncy bjscd ddull vocdljonul !nslruclion and to 
effectively implement new courses, specidi dllenlion should bt given to (a) pre.dssess- 
ment of learners upon eptry, (b) allowing learners to progress as soon as competencies 
are achieved rather than basing instruction upon clock hours, (c) providing learning al- 
ternatives to accon^modate various learning styles, and (d) evaluating students on their 
ability to perform specified objectives which describe the conditions and standards of 
performance. 

7. Trainers in the private sector should look to the public sector for leadership in the plan- 
ning and^operatioq of competency based adult vocational instruction. This is particularly 
true for trainers in busim industry and labor, since proprietary schools appear similar 
to the public sector with regard to competency based instruction. This recommendation 
may be hard to accept for professionals in both sectors, but it is supported by data ob- 
tained in the national survey. 

t 

8. ' Adult vocational educators in the public sector need to place greater emphasis on the 

implementation of year round competency based instruction for adulis as is being done 
in the private sector. The benefits of greater program flexibility, effective implerhentation 
of open entry/open exit concepts, and more^ varied schedules to meet the unique require- 
ments of the adult population would ensue. , Beyond these instructional advantages, 
facility utilization would be increased and more adults could be served each year. Imple- 
mentation of this recommendation would be an important means of demonstrating ac- 
countability to the public, and should foster increased public support. 

9. Further research needs to be conducted in which all types of courses,' competency-based 
and others which are not, would be rated on the 19 course descriptors employed in this 
study. Such a study could more effectively determine which course descriptors are es- 
sential for strong competency based courses to exist, using multivariate techniques such 
as canonical correlation. 

10. Further research should also attempt to improve the precision with which many terms 
related to competency-based instruction are commonly used. 



ERLC 



49 

CO 



APPENDIX A 

Initial Letter Sent to the Public Sector 
Requesting Nominees 



ERIC 



51 



61 




THE CENTER FOR VOCATIONAL EDUCATION 



The Ohtp Slate University • 1960 Kenny Road • Columbus. Ohio 43210 
Tel (614) 486 3655 Cable CT VOCEDOSU/Columbus, Ohio 



The Center for Vocational Education has a grant from the U* S. Office of 
Education, Bureau of Occupational and Ad^ilt Education, to conduct a stud^'- of 
"Competency-Based Adult Vocational Education Programs" now in progress in the 
United States. The goal of this project is threefold: 

1) To conduct a study of the characteristics of competency-based 
adult vocational programs, 

2) To develop a directory of such programs in the United States 
for the use of interested professionals, and 

3) To conduct a national dissemination workshop through which 
programs and concepts of competency-based advLLt vocational 
education could be shared and exchanged, allowing developers 
of adiilt vocational programs to be further trained in the 
corapetency-based concept. 

The purpose of this letter is to solicit from you the names of profes- 
sionals in your state who are involved with corapetency-based adult vocational 
programs, either in public education, other government agencies, or business/ 
industry. The reasons for compiling a list of adult educators who operate 
ccnipetency-based programs is to identify people with whora we woiild communicate 
to gather specific information on competency-based programs, and also to iden- 
tify possible consultants to the project. A form is enclosed which may be 
helpful to you in providing this information. A post-paid envelope is also 
enclosed. 

Thank you very much for your attention to this request. We look forward 
to hearing from you in the next few aays as we identify the target group to be 
served by the project. 

Sincerely, 



Earl B. Russell 
Project Director 
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CarCACT PB3RSCNS FOB 
COMPFTSNCY-BASED ADUI^: VOl^TIONAL EDUCATION ^^GRAMS 
IN PUBLIC SCHOOLS, OTHER G0Vi3lNMENTAL AGETJCIES, OR 3USIlxr.SS/INDUSTRY 



RAKE: 



*.«*^ AGENCY: 



ADDRESS - 



TKUEyHCRE:^ 

KAfDS: 

AGERCY: 

AD£Sl£SS: 



TEXBPHOIE:^ 

KAMS: 

AGERCY: 

ADDRESS: 



tELEPHONB: 

RAKE: 

AGEJtCY: 

ADDRESS: 



TBtEFHCHE: 

NAME: 

AGENCY: 

AD1BESS: 



TELEPHCWE: 

TKIZPHCKE:^ 



KANE: 

HAKE: J 

AGENCY: 

AGI3rcY:_ — 

ADDRESS: 

ADDRESS: 



. TEI£PHONE: 

TELEPHCWE: 



KAMS: 

SAKE: 



AGENCY: 

AflBfCY; — 

ADDRESS: 

ADDRESS: 



TELEPHCNE: 

TELEPHCME: ' 
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Volume XI, No !:> 



IDENTIFICATION AND ANALYSIS 
OF COMPETENCY-BASED ADULT 
VOCATIONAL^irraCATION PROGRAMS 



Decern Ixjr 1976 



Relatively l.iiie *s kjiuwn about the i>tdtu:> of competency based programs of adult vocational education 
tn the United States. Judging by diffuiunces iri terminology and the degree of reporting about specific 



adults IS limited. However, education, busmesj, industry, and government agencies appear to be increasing 
their efforts m the competency-based approach to learning and training. 

Recognl^mg the need for improved adult vocational education programs, the U.S. Office of Education, 
Bureau ui Occupational and Adult Education, is sponsoring a twelvemonth project at The Center entitled, 
"Identification and Analysis of Competency Based Adult Vocational Education Progra(Tis." The purpose of 
this project is to assemble information on competency based programs for adult learners in public and private 
vocational education and to disseminate tiiat information to developers of aduit voca«.ional education pro 
grams. In particular, this study will. (1) identify and describe characteristics of specific competency based 
adult vocational education programs m public and private vocational education, (2) provide the profession 
With information and supporting data on the status of competency based adult vocational education programs 
sponsored by business, industiy, and education so that developers and operators will have a readily available 
source of assistance, artd (3) conduct a national dissemination workshop through which programs and concepts 
of competency based adult vocational education could be shared and exchanged, allowing developers of adult 
vocational programs to be further tramed rn the competency-based concept. 

Working with a panel of consultants, project staff will develop a set of criteria for selecting competency- 
based adult vocational programs for stuoy Concurrently, a list of agencies involved in such programs will be 
compiled from the literatuie and individual referrals. Key administrators in each of the identified agencies will 
be asked to oro^ide nominat ons of individuals oi specific agencies which should be contacted regarding their 
involvemen with competency based adult vocational education programs. The criteria applied to selection of 
competency based programs at hii, stag*.' is viewed as a critical aspect c^ the project. Subsequently, a mail sur 
vey of competency based proyramj, for adults will Ixj conducted among persons who were identified as operat 
ing these programs ApproAimately ten programs will be selected for on site review. Based upon the findings of 
the survey, descriptive analyses of surveyed programs will be presented in a technical report and in a program 
directory. To disseminate thi5 information, a workshop will be conducted for adult vocational education pro 
gram developers. 

Four different documents will be outputs of the project. The first will be a directory of competency- 
based pduil ;/ocational edocatiun progiams. This duectory will be the first of its kind and will be valuable to 
program developers and operators as well as program students The second will be a technical report of the 
survey program characteiistics and will serve as a major input to the workshop. Third, the workshop proceed- 
ings will De prepated and distributed to participants, other interested individuals, and major information 
systems in the nation. Lastly, a final report will be prepared. 

Expected outcomes from these products include (1) improved access to competency based adult voca 
tional programs by program developers and subsequently adult learners, (2) improved information rtgarding 
the status of and the methods in competency based adult vocational education, and (3) specific plans of action 
for program mprovement by worl^shop participants 

Persons who know about specific competency fjased vocational programs fox adults are asked to contact 
Earl B, Russell, project director at The Center, (6M) 486-3655, 



competency based progiains, it is appaiuit that communications among the various teachers and trainers of 



A publication of The Center for Vocational Education 
The Ohio State University, V^60 Kenny Road, Columbus, Ohio 43210 
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November 1976 



ANNOUNCEMENT 



COMPETENCY-BASED PROGRAMS FOR ADULTS? 



A 12-2nonth project titled, "Identification and 
Analysis of Competency-Based Adult Vocational Education 
Programs," has just begun at The Center for Vocational 
Education. The purpose of this project, funded hy the 
U. S. Office of Education, Bureau of Occupational and 
Adult Education, is to assemble information on compe- 
tency-based programs for adidt learners in education, 
business/industry, and government agencies. 

Major project efforts will be to svirvey such pro- 
grams, prepare a national program directory, and conduct 
a workshop to disseminate project findings to program 
developers and operators. Persons who Imow about specific 
competency-based vocational programs for adults are asked 
to pass such information along to Earl Russell, Project 
Director, at The Center for Vocational' Education, The Ohio 
State University, i960 Kenny Road, Columbus, Ohio 1^3210. 
The phone number there is (Slk) ^^86-3655. 
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THE CENTER FOR VOCATBONAL lEDUCATION 

The Ohio State University • 1960 Kenny Road * Columbus, Ohio 43210 
Tel: (614)486-3655 Cable: CTVOCEDOSU/Columbus, Ohio 



The Center for Vocational Education has a grant from the U. S. Office of 
Education, Bureau of Occupational and Adult Education, to conduct a study of 
Competency-Based Adult Training and Development Programs now in progress in the 
United States. The goal of this project is threefold: 

1) To conduct a study of the characteristics of competency-based 
adult training and development programs, 

2) To develop a directory of such programs in the United States 
for the use of interested professionals, and 

3) To conduct a national dissemination workshop through which 
programs and concepts of competency-based adult training and 
development could be shared and exchanged, allowing developers 
of such programs in both the private sector and public schools 
to be further trained in the comyetency-based concept. 

For the purposes of thir project we are operationally defining competency- 
based programs as being comprised of a job/task analysis, performance objectives, 
individualized instruction, and criterion referenced testing. 

The purpose of this letter is to solicit from you the names of professionals 
you are acquainted with who are involved with competency-based adult training and 
development programs in business and industry. The reasons for compiling a list 
of adult trainers who operate or have developed competency-based progr^^ms is to 
identify people with whom we would communicate to gather specific information 
oh competency-based programs, avJ. also to identify possible consultants to the 
project. A form is enclosed which may be h.-^lpful to you in providing this infor- 
mation. A post-paid envelope is also enclosed. 

Thank you very much for your attention to this request. We look forward to 
hearing from you in the next few days as we identify the target group to be 
served by the project. 

Sincerely, 



Earl B. Russell 
Project Director 
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THE CENTER FOR VOCATIONAL EDUCATION 



The Ohio State University • 1960 Kenny Road • Columbus, Ohio 43210 
Tel: (614) 486-3655 Cable: CTVOCEDOSU/Columbus, Ohio 



Dear Professional : 

I am writing at the suggestion of Hazel Brown, President of the Harry Lundeberg 
School of Seamanship, regarding a project we have underway. The Center for Voca- 
tional Education has a grant to conduct a survey of competency-based adult training 
and de»/elopment programs now in operation in the United States. The purpose of this 
survey is to identify exemplary approaches in this field and share the findings with 
interested parties. The main result of this effort will be an identification of 
methods by which instructional content is offered rather than the content itself. 
It is our belief that labor, business, and industry, as well as the educational • 
sector vnll benefit from this project through improvement of the work force at less 
cost and time. For your information, the enclosed brochure contains a more detailed 
description of'our project, an explanation of the products to be developed, and 
information about the forthcoming National Workshop based on project findings. 

From our understanding of your organization, we suspect that perhaps one or 
more of the training efforts under your control are competency-based. Competency- 
based instruction is being operationally defined as possessing such features as 
clearly stated performance objectives based upon job or task analysis, individualized 
instruction, and criterion-referenced (objectives-based) testing. A glossary of key 
terms used in the survey is enclosed for your reference. 

If you administer the training activities conducted by your staff, we would 
appreciate your asking a staff member who is practicing competency-based training 
to participate in this rasearch. Please select a course you feel is particularly 
EXEMPLARY of competency-based instruction. 

Your participation in this effort will result in the identificdtion of competency- 
based ?duU vocational instruction, and with your persmission, may place a description 
of your treining in a National Directory that can be used by others to identify con- 
tacts for consultation or information exchanges relative to competency-based 
instruction. 

We appreciate very much your cooperation and participation. A complimentary 
summary of findings will be made available to all participants. 

Sincerely, 



EBRrmdm 
g;''"'osures 
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Earl B. Russell 
Project Director 
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THE CENTER FOR VOCATIONAL EDUCATION 



The Ohio State University • 1960 Kenny Road • Columbus, Ohio 43210 
Tel: (614) 486-3655 Cable: CTVOCEDOSU/Columbus, Ohio 



Dear Director: 

The Center for Vocational Education has a grant from the U. S. Office of 
Education, Bureau of Occupational and Adult Education, to conduct a study of 
Competency-Based Adult Training and Development Programs now in progress in the 
United States. The goal of this project is threefold: 

1) To conduct a study of the characteristics of competency-based 
adult training and development programs, 

2) To develop a National Directory of such programs in the 
United States for the use of interested professionals, and 

3) To conduct a national dissemination workshop through which 
programs and concepts of competency-based adult training and 
development could be shared and exchanged, allowing developers 
of such programs in both the private sector and public schools 
to be further trained in the competency-based concept. 

It is our belief that business, industry and labor, as well as the educational 
sector, will benefit from this project through improvement of the work force at 
less cost and time. 

For the purposes of this project we are defining competency-basied programs 
as being comprised of a job/task analysis, performance objectives, individualized 
instruction, and criterion-referenced testing. Adult training and deve.opment 
programs should be of the non-credit, non-degree type. 

Marie Piekarski, Coordinator of Program Planning and Development at the 
University of Kentucky, Community College System suggested your organization as 
a source of information about adult education and training programs in the health 
areas. The purpose of this letter is to solicit f rom yo i names of persons in- 
volved in competency-based instruction at the operational level who we might 
communicate with to gather further information about their competency-based 
programs. Three forms and a post-paid envelope are enclosed to help you in 
providing this information. A "Centergram" article is also enclosed for your 
review. 
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Thank you very much for your assistance. We look forward to hearing from 
you in the next few days as we are getting our survey underway. 

Sincerely, 



Earl B. Russell 
Project Director 

EBR:mdm 
Enclosures 
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THE CENTER FOR VOCATIONAL EDUCATION 



The Ohio State University • 1960 Kenny Road • Columbus, Ohio 43210 
Tel: (614) 486-3655 Cable: CTVOCEDOSU/Columbus, Ohio 



VJe need your assistance in identifying a select group of local vocational 
education personnel either in secondary or post secondary schools. The Center for 
Vocational Education has r grant from the U.S. Office of Education, Bureau of Occupa- 
tional and Adult Education, to conduct a study of **Competency-Based Adult Vocational 
Education Programs" no^ in progress in the United States, The goal of this project 
is threefold: 

1) To conduct a study of the characteristics of competency-based adult 
vocational programs, 

2) To develop a directory of such programs in the United States for 
the use of interested professionals, and 

3) To conduct a national dissemination workshop through which programs 
and concepts of competency-"based adult vocational education could 
"be shared and exchanged, allowing developers of adult vocational 
programs to iDe further trained in the competency-based concept. 

For the purposes of this project we are operationally defining competency- 
based programs as being comprised of a job/task analysis, performance ob je<^.tives, 
individualized instruction, and criterion-referenced testing. Adult vocational 
programs should be of the non-credit, non-degree type. 

The purpose of this letter is to solicit from you the names of vocational 
teachers or administrators in local schools in your state who are conducting 
competency-based adult vocational programs. The reason for compiling a list of 
local adult educators who operate competency-based programs is to identify people 
with whom we would communicate to gather specific information on competency-based 
programs. A form is enclosed which may be ?ielpful to you in providing this 
information. A post-paid envelope is also enclosed. 

Thank you very much for your attention to this request. We look forvrard to 
hearing from you in the next few days as we identify the target group to be 
contacted by the project. 

Sincerely, 
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Earl E. Russell 
Project Director 
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f/X:AL GCJR)OL CONTACT PERSONS FOR 
COMPETENCY-BASED ADUI.T VOCATIOllAL EDUCATION PROGRAMS 



NAME: 

ADIHBSS: 



NAME: 

AGraiCY:_ 
ADDRESS: 



TELEPHOrn:: TRI^PHOt^B: 



HAMB: NAME: _ 

AGENCY : AOfHiry • 



ADDRESS: ADDRESS: 



TKIiEPHOKE: 

NAME: 

AGENCY: 

ADIBESS: 



TE[£PHCXn?: 

NAME: 

AGENCY: 

ADDRESS. 



TEIZPHONE: TELEPHCim: 



RAME: 

AGENCY :_ 
ADIBESS: 



NAME: 

ACRIICY'^ 
ADDRESS: 



TBLEPHCWE: 



TELEPHONE: 



RAMZ" 



AGSfCY: 



ADmESS: 



NAME: 



Af;mCY:_ 
ADDRESS: 



TELEPHOfE: 



TKiJ^PHorir:: 



ATTAiri EXTRA PAfiK^J TT mTEV>VAii'{ 
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THE CENTER FOR VOCATIONAL EDUCATION 

The Ohio State University • 1960 Kenny Road • Columbus. Ohio 43210 
Tel: (614)486-3655 Cable: CTVOCEDOSU/Columbus. Ohio 



s 



The Center for Vocational Education has received a grant from the U. S. Office of 
Education, Bureau of Occupational and Adult Education, to conduct a study of 
"Competency-Based Adult Vocational Education Programs" now in progress in the United 
States. The purpose of this project is threefold: 

1) To conduct a study of the characteristics of competency-based adult 
vocational instruction, 

2) To develop a National Directory of such instruction in the United 
States for the use of interested professionals, and 

3) To conduct a national dissemination workshop through which the state 
of the art in competency-basad adult^ocational education could be 
shared and exchanged. 

It has been suggested to us that a course or courses under your direction are 
"competency-based" adult vocational education or training. We are defininfr comoetency- 
based instruction as having clearly stated performance objectives based upon a job or' 
task analysis, individualized instruction, and criterion-referenced (objectives-based) 
testing. 

V7e would, at this time, like to know if you would be interested in oarticipating 
in this study and having your courses included in the National Director^^ If so, 
will send you sufficient cories of a survey form to be completed by your instructors 
who teach adult competency-based classes. Wou]d you kindly take a* moment to fill out 
the enclosed Dostage-paid postcard and return it to us as soon as oossible with the 
information requested? 

Your participation in this study will resiilt in the identification of competency- 
based adult vocational instruction, and may add, with your permission, courses from ' 
yo\ir Instit-M.on to the National Directory as a contact point for consulting and 
information 'changes relative to comoetency-based instruction. 

VJe aDDi .ate your cooperation and participation. A complimentary summary of 
findings will be made available to all participants. 

Sincerely, 



Earl B. Russell 

EBR:mdm 81 Project Director 
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RAKB: 



TITLE 
ADDRESS: 



TEIJBPHONE : 

I consider ours a Competency-Based Adult Vocational 
Education or Training Program and would like to par- 
ticipate in the project. 

I am not sure if ours is a Competency-Based Adult 
Vocational Education or Training Program but would 
still like to participate in the project, 

I do not consider ours a Competency-Based Adult Voca- 
tional llducation or Training Program and feel that it 
would be inappropriate for us to participate. 

HOW MANY TEACHER FORMS WILL YOU NEED? 
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THE CEl^TER FOR VOCATIONAL EDUCAT50N 

The Ohio State University • 1960 Kenny Road • Columbus, Ohio 43210 
Tel: (614)486-3655 Cable: CTVOCEDOSU/Columbus, Ohio 



Dear ASTD Chapter President: 

Wiih the support of the Central Ohio Chapter of ASTD and the cooperation of 
Chapter President Charles D. W. Thornton, this letter is sent to you as President 
of your ASTD Chapter. The purpose of this communication is to solicit your 
assistance with our project. 

The Center for Vocational Education has a grant from the U. S. Office of 
Education, Bureau of Occupational and Adult Education, to conduct a study of 
competency-based adult training and development programs now in operation ^n the 
United States. The goal of this project is threefold: 

1) To conduct a study of the characteristics of competencyrbased 
adult training and de^^elopment programs, 

2) To develop a National Directory of such programs \j\ the United 
States, and 

3) To conduct a national dissemination workshop through which 
programs and concepts of competency-based adult training and 
development could be shared and exchanged. 

/ 

For more information, please see the attached brochure which has a more 
detailed description f the project. 

For the purposes of this project we are defining competency-based progn^ms 
as being comprised of a job/task analysis, performance objectives, individualized 
instruction, and criterion-referenced testing. In addition, these programs should 
be non-degree and non-credit granting to be included in the survey. 

The enclosed survey has been developed to collect the information we need to 
meet the above stated goal . ^ We would appreciate yoi.r bringing this survey, and 
our project, to the attentio^n of you]- Chapter membership so that those who wish to 
respond could do so. We would be happy to supply a few more copies of the survey 
if more are requested. 

Thank you very much for your attention to this request. We look forward to 
hearing from a representati ve(s) of your ASTD Chapter. 

J , Sincerely, 



y ?:mdm 85 
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Earl B. Russell 
Project Director 
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NATIONAL PANEL OF CONSULTANTS TO THE PROJECT, 
"IDENTIFICATION AND ANALYSIS OF 
COMPETENCY-BASED ADULT VOCATIONAb EDUCATION PROGRAMS" 



Name/Title 



Organization 



Hazel P. Brovm 
President 



Harry Lundeberg School of Seamanship 
Piney Point, Maryland 



Ben A. Hirst, Jr. 
Executive Director 



Vocational- Technical jSducation 
Consorbimn of States (V-TECS) 
Southern Association of Colleges and Schools 
Atlanta, Georgia 



Chester S. Janus zewcki ^ 

Project Manager-Functional Planning 



Western Electric Company 

Bell System Training Center (National) 

Dublin, Ohio 



John R. Kobe 

Adult Vocational Director 



Suburban Hennepin County Area Vocational- 
Technical Centers 
Minneapolis, Minnesota 



Marie L. Piekarski 
Coordinator of Program Planning 
and Development 



Community College System 
University of Kentucky 
Lexington, Kentucky 



Bernardo R. Sandoval 
Assistant Director, 
Manpower Program Development 



Los Angeles City Unified School District 
Los Angeles, California 



Lucille E. Wright 
Educational Specialist 



Division of Vocational Education 
Cleveland State University 
Cleveland, Ohio 
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— THE CENTER FOR VOCATIONAL EDUCATION 



The Ohio State University • 1960 Kenny Hoad • Columbus, Ohio 4321C 
Tel: (614)486.3655 Cable: CTVOCEDOSU/Co'lumbus, Ohio 



Dear Instructor: 

The Center for Vocational Education has a grant from the U. S. Office of 
Education, Bureau of Occupational and Adult Education, to conduct a study of 
competency-based adult vocational instruction. This national research is new in 
progress with selected personnel in education, business/industry, and government 
agencies. 

Leaders in your state and/or ycur director inform us that you teach a course 
or courses through the use of competency-based adult vocational instruction. We 
are ^operationally c ;ning competency based instruction as having clearly stated 
performance objectives based upon a job or task analysis, individualized instruc- 
tion, and criterion-referenced (objectives-based) testing. The adult vocational 
instruction we are surveying should be of the non-:redit, non-degree type. 

The enclosed survey is designed to obtain three tyoes of data: 

1) Infonndtion on how your course relates to the "textbook" 

characteristics of competency-based instruction. 
?) Descriptive data on your course (i.e., content coverage, 

enrollment, etc. ), and 
3) A description of your course for possible inclusion in the 

N ational Directory of Competency-Based Adult Vocational 

Instruction , if you grant us permission. 

Your participation in this study will result in the identification of 
competency-based adult vocational instruction, and may add your course to the 
National Directory as a contact person for consulting and information exchanges 
relative to competency-based instruction. Please complete this survey for the 
MOST EXEMPLARY competency-based course. 

The enclosed brochure may be helpful to you when describing this project to 
your director or other incerested persons. A form is provided in the brochure 
for those interested in attending the National Works, jp based upon project findings. 

We appreciate your <.ooperation and participation. A complimentary summary 
of findings will be made available to all participants. 



Sincerely, 



EBR:mdm 
closures 
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Earl B. Russell 
Project Director 
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THE CENTER FOR VOCAtlONAL EDUCATION 



The Ohio State University • 1960 Kenny Road • Columbus, Ohio 43210 
TeL (614)486 3655 Cable: CTVOCEDOSU/Columbus, Ohio 



Dear Professional : 

The Center for Vocational Education has a grant to conduct a survey of 
competency-based adult training and development programs now in operation in the 
United States. The purpose of this survey is to identify exemplary approaches in 
this field and sh.ire the findings with interested parties. The main result of 
this effort wi il be an identification of methods by which instructional content 
is offered rather tfian the content itself. It is our belief that business, 
industry and labor, as well as the educational sector, will benefit from this 
project through improvement of the work force at less cost and time. For your 
information, the enclo'sed brochure contains a more detailed description of our 
project, an explanation of the products to be developed-, and the National 
Workshop based on project findings. 

Training leaders advise us that one or more of the training efforts under 
your control are compete )cy-based. Competency-based instruction is being opera- 
tionally defined as possessing such features as clearly stated performance 
objectives ^jased upon job or task analysis, individualized instruction, and 
criterion-referenced (objectives-based) testing. A glossary of key terms used 
in the survey is enclosed for your reference. 

If you administer the training activities conducted by your staff, we would 
appreciate your asking a staf^ member who is practicing competency-based training 
to participate in this research. Please select a course you feel is particularly 
EXEMPLARY of competency-based instruction. 

Your participation in this effort will result in the identification of 
competency-based adult vocational instruction, and with your permission, may 
place a description of your training in a National Directory that can be used by 
others to identify contacts for consultation or information exchanges relative to 
competency-based instruction. 

We appreciate very much your cooperation and participation. A complimentary 
summary of findings wili be nade ^ 'ailable to all participants. 



Sincerely, 



Q EBR:mdm 
]C Fnrln<;!irp<; 



Earl B. Russell 
Prnjoct Director 
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GLOSSARY 



The U;rms m tins glossary are idoiuifiod m italics in Section I of the Form. 
Please READ CAREFULLY before compleiino the form. 



ADULT VOCATIONAL EDUCATION Instruction for "out of school" person: generally above the age of 16 

which ts designed to prepare or upgrade occupational skills, except programs leading i<j degrees of any kind. 

COMPETENCY-The ability to perform a given task under specified conditions at un acceptable pioficiency level. 

COMPETENCY BASED INSTRUCTION Based upon d iob/task analysis, and consisting of elements such as per 
formance obiectives, individualized instruction, and v,riterion-referenced testing. 

CONDITlONS~(pdrt of an objective) The particular limits and ciicumstances of the job environment which will 
be tak*>n into consideration when the learner's performance is practiced and evaluated. 

COURSE -The unit of instruction taught by one instructor or a team of instructors working together. 

CRITERION-REFERENCED TESTING Based upon a ^jeifurmance objective and designed to determine whether 
or not the learner has accomplished the objective (criterion). 

ENTRANCE REQUIREMENTS Abihtibs thct the learner must uossess/exhibit pr or to beginning a period of 
instruction. 

EXIT RE'^UlREMENTS The specific behavior the 'uarrier is to exhibit at the end of a period of instruction and 
t'ojQd upon a criterion*refe*'enced measure. 

INDIVIDUALIZED INSTRUCTION ProviOmg learners with opportunities for independent achievement of per 
fornridnce objecti ^s. This ranges from dif ferentiatiny one learner from another simply by the rate at which 
a sequence of ac^ -ities is undei taken and con»pleted to differentiating by providing optional sequences. 

JOB ANALYSIS The piocessof identifying duties and t sks which comprise workers' responsibility including 
the collection and analysis of such data. 

OPEN ENTRY. OPEN EXIT Learners can enter oi leave the piogram of in'itruction ot any time or point dependent 
on the competencies possessed 

PERFOR' ANCE OBJECTIVE A statement specifying what learners will be required to do in terms of terminal 
observable behavior, conditions under which the behavior will be exhibiteu, and the acceptable level of 
performance 

STANDARD The level of the 'earner's performance which will be deemed minimally acceptable^ 

TASK A unit of work activity ur opeiatiun that coris^itut'.'s a logical and necessary step in the performance of 
a duty. It usually consists of two or more steps, 

TASK ANALYSIS The process ot a< aiy^ing data on tasks identified m d |ob analysis to aid .n determining tram 
ing requirements. 
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NATIONAL SURVEY OF COMPETENCY-BASED 
ADULT VOCATIONAL INSTRUCTION 



Instructor Survey 



INSTRUCTIONS FOR COMPLETION CF THIS FORM 



1. This form should be completed for only ONE oourse. We realize that you may offer more 
than one instructional course that would qualify as competency-based instruction. How 
ever, please select the ONE you believe to l^e the most EXEMPLARY olcompetenoy-based 
adult vocational instruction offered. By exemplary we suggest that you choose the ONE 
which, in your opinion, is the best working example of comjjetency -based instruction. If 
you wish to describe more than one of vour courses, please duplicate this form. 

j 2. The form is divided into tfiree sections. Specific instructions are cov.ered m each section. 

3. Please complete Section 111 even though you may not wish your course to be considered 
tor inclusion in the National Directory. There is a space for you to indicate your prefer- 
ence. Information will not m published without your written oermission/approval. 

4. When completed, please fold in half, staple or tape, and mail. 

5. If you would like to be notified when the firial report and National Directory are made 
available, please check here. T < 



THANK YOU FOR YOUR COOPERATION IN THIS SURVEY! 




THE CENTER FOR VOCATIONAL EDUCATION 
yTHE OHIO STATE UNIVERSITY 
t^Mot^ 1960 Kenny Road Columbus. Ohio 43210 
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SECTION I 

The italicized terms in this section are defined in the glossary provided. 

The purpose of this section is tu collect informdtion dljout your course in teimi> of ttie extent to which il reldteb to 
competency 'based instructional features. 

If you feel that your iiibtructjoii uaa be cidbbified di> competency based . please indicatu whether the folluwing char- 
acteristics^re evident in yuui cuurbe, Thu fulluwmg iturrib describe com f^etency based instruction by most text 
book" definitions. We do not necessarily expect tfiat yuui or any other course will p^osess all characteristics to a 
strong degree. 

Please place in the bux tu the nght a 1 if yuu feel that your course of inbtruction definitely possesses the stated 
characteristic, a 2 if you leel that it somewhat possesses the stated characteristic, d 3 »f you feel that >t does not 
possess the stated charactei istic, and d 4 if you feel that t.«e btated chdracteristiu ib unusable or not applicable ii 
your Situation. 



1 ^ definitely 
possesses 



2 ^ 


somewhat 




possesses 



does not 
possess 



4 ^ unusable or 
not applicable 



COURSE NAME : 

A . ST R UCT U R E 0 F CO URSE 

Learners are held responsible for meeting stated performance objectives 

Learners are pre-assessed upon entry to determine learners skills and 
objectives to be achieved, rather than all learners covering the same objectives 

Learners know the measures for which they are held accountable 

Instruction is segmented into manageable units, each containing related |ob skills 

Learneri) are responsible for achieving the competencies as opposed to clock 
hours of attendance 

Le^irner performance is recorded as oach objective aclMev/ecl 

Greater emphasis is placed upoi exit requirements (profit ency) than upon 
entrance requirements 

Competencies are derived from ^ task or job analysis of the particular jo.^ 

Student assessment criteria are based upon comjxjtencies (i.e , criterion 
referenced testing is used) 

Continuous evaluation aiul feedback to the learner is provided 

Individual leaTnor competence is deterrni.ied by indivuiual learner performance 
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PLEASE MARK YOUR 

RESPONSE HERE 
(Numbers down margin 
;ire for project use or>'y) 



LJ 

rj 



CD 



6 
7 

8 
9 
10 

11 
12 

13 
14 

15 
16 
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1 


definitely 




possesses 



2 


somewhat 




possesses 



3 


does not 




possess 



4 


unusable or 




not applicable 



Each learner is allowed to proceed to subsequent instruction as quickly as 
performance objectives a r e a 1 1 a i n ed 

instruction offers learning alternative; for learners (i.e., different approaches) 

Instruction specifies media to be used to accomplish objectives 

If a learner does not achieve a learning task, a different nethod of instruction 
is provided or suggested 

B. TERMINAL PERFORMANCE OBJECTIVES 

Objectives describe the conditions under which the leorner will be expected 
to demonstrate the level of competency 

Objectives describe the level of competency or standards (set by business or 
industry) to be demonstrated 

Objectives d^^cnbe the tasks to be learned 

Objectives are structured in a sequential order or m order of task difficulty 



YOUR RESPONSE HERE 
(Numbers down margin 
are for project use only) 



□ 



17 

18 
19 
20 



21 

22 

23 
24 



SECTION II 

The questions m thii iection are to collect descriptue information about your course. When responding to the items 
think in terms of the preceding 12 months for your course. Read each one carefully and respond to the question 
in the appropriate box to the right. When recording duy number please regard that number as a four (4) digit num- 
ber and record it like this . . . 

The number "34" would bp recorded as: 
or 

The number "200" would be recorded as: 



A, How many hours of instruction are required for a learner to complete your 
course? (Please state actual number of hours in 1, 2, AND 3, OR ONLY 
check 4 if that applies as your response ) 

1 Minimum hours 

2 A'^erage hours 

3, Maxinnum hours 

4. Not applicable, completely open entry/open exit 

B. As a result of the analysis of the job, how many competencies (tasks) have 
been identified for this entire course^ (Please state the actual number of 
competencies (tasks)) 



PLEASE MARK YOUR 

RESPONSE HERE 
(Numbers down margin 
are for project use only) 



25-28 
29-32 
33-36 
37 

38-40 
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How many terminal performance objectives, based upon the competencies 
(tasks), are included m this course? (Please state the actual number.) 



YOUR RESPONSE HERE 
(Numbers down margin 
are for project use only) 



T I 4,-43 



What is the approximate total enrollment in your course, by the learner's sex? 
(Please state approximate numbers) 

1 female 
2. Male 



44-46 
47-49 



Does your course have an active advisory council? 

1. Yes 

2. No 



50 



If yOu have an active advisory council, what people are represented? (Please check all that apply) 



Union 
Representatives 
□ ^ 
51 



Business 
Reps 
□ 
52 



Industry 
Reps 

53 



University 
Reps 
□ . 
54 



College 
Reps 

□ 

55 



School 
Officials 

□ 

56 



Community Private Propriet?ry 

Leaders School Officials 

□ □ 

57 58 



Oihers; 

□ 

. 59 



Do you have a placement prop' am for learner? completing your instruction? 



1. Yes 

2. No 

3. Other (please explain) 
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Do you have a system for follow up of your corripleters? 



1. Yes 

2. No 

3. Other (please explain) 
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Please check the apuropnate i^ox oi boxus for thu months of the yoar that your course of^erates 



ALLYEAR 

□ 
OR 
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JAN FEB MAR APR MAY JUN JUL AUG SEP OCT NOV DEC 



□ 
63 



n 

64 



65 



rj 

66 



67 



□ 
68 



69 



70 



! j 
71 



72 



73 



74 
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Would you please share with us any problems that you might have encountered in developing and opereting 
this conripetency based course^ (Please attach additional sheet marked with a "J" if necessary,) 



K Would you plOdSe share with us any ideas on how your competency-based' course can be ir^^roved? {Please 
attach an adoit.onal sheet marked with a "K" if necessary.) 



A workshop .ill be held on August 2 5, 1977 to disseminate tne findings of the >tudy and to assist participants in 
developing i ndividualized pidns of action for improving their adult vQcationo. instruction. If you would like to be 
placed OP a MAILING LIST of POTENTIAL WORKSHOP PARTICIPAN"^S, please print your name: 



SECTION 111 

Thank you for your vvork to this point' This remdining section is extremely important to both this study 
and the recognition which may be focused on your efforts. 



The National Directory ^ iK be a resource to be used by course developers and operators all over the country 
If you give us permission, the detailed description which you submit will be the source for Directory users to learn 
about your instructional activities. 

1. On the following two pages is the FORMAT m which the DESCRIPTION of your COURSE would appear, 
with your permission, if selected to be included in the National Directory. 

2. Please make your descriptions concisu drjd complete, using a few SENTENCES per category RATHER THAN 
SINGLE WORDS OR PHRASES. 



3. 

4. 
5. 



TYPE or PRINT directly or, this form or use separate sheets of paper. 
I'; eithe' case please use tiie outline and categories listed. 

Include all the information you regard as purtu.unt to adequately describe your competencybased adult 
vocational course 



6. Please check (A this box if you DO NOT wi.h us to publish this informdiion in the National Directory. □ 
We will send "erification of your wish NOT to publish. 



ERLC 
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DESCRIPTION OF COURSE FOR POSSIBLE INCLUSION 
IN THE NATIONAL DIRECTORY 0? CBAV COURSES 
(Please TYPE or PR INT your description on this form or some facsimile) 



COURSE TITLE: 



NAME OF FACILITY AND ADDRESS, 



CONTACT PERSON: Phone Number! ) 



TYPE OF TACILITY IN WHICH COURSE IS OFFERED: (Please check one) 

D Business D Public Secondary lZ Proprietary School 

D Industry G Adult Skills Center Zj Junior/Community College 

D Union Sponsored u3 Public Technical Institute lZ Lniversity 

Li Other (Specify) 



HOW WERE TASKS IDENTIFIED IN THE JOB ANALYSIS? 



HOW WERE PERFORMANCE 08 »CCTIVES DEVELOPED AND VALIDATED? 



HOW IS INSTRUCTION DELIVERED" (Foi exdmpie, via modules, upen entry/open exit, or other format) 



106 



WHAT IS THE NATURE OF STUDENT TESTING' (For (.'xdmplu, du ril)el)JSis, mclhocis. extent) 



t 



WHAT IS THE NATURE OF COURSE EVALUATION? (How reviewed, revised, who is involved, etc.) 



WHAT IS THE NATURE OF THE SUPPORT SYSTEM OF YOUR INSTRUCTION? (i.e., advisory groups, ad 
ministration, funding base) 



THANK YOU VERY MUCH FOR YOUR TIME AND ENERGY IN ASSISTING US WITH THIS PROJECT 



IF YOU KNOW OF ANY OTHER INSTRUCTOR(S) WHO SHOULD RECEIVE A COPY OF THIS SURVEY, 
PLEASE SEND US THEIR NAME(S) AND ADDRESS(ES); 



NAME NAME: 

TITLE- TITLE: _ 

agencyI agency- 

ADDRESS: ' ADDRESS: 



TELEPHONE TELEPHONE: 

107 

97 



ERIC 



I 



h VOCATIO 




A/313dlMOO 



noA >iueqi'-JdqidBoi ddei jo djcleis pue dut/ siqi 6uo/e p/o; dsed/cf 



Postage 
Will Be Paid 
by 

Addressee 



No 

' Postage Stamp ] 

Necessary 
, If Mailed in the | 
.United StateSi 



BUSINESS REPLY MAIL 

FIRST CLASS PERMIT NO. 184 COLUMBUS, OHIO 



OHIO STATE UNIVERSITY 
242 W. 18th AVENUE 
COLUMBUS, OHIO 43210 



Dr. Earl B. Russell 

The Center for Vocational Education 
1960 Kenny Road 
3030-340227.322A 
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trained in the competency-based concept 
Participants will develop individual plans of 
action- If you are interested in receiving 
more information on this workshop to be 
held August 2-5. 1977, please complete 
the form provided and return to The 
Center 

3. Workshop Proceedings 

Since the workshop will be «i forum 
for sharing and exchanging ideas, the pro 
ceeding^ of these sessions will be pubhslied 
and made available The workshop pro 
ceedings wiM emphasize practical steps in 
the implementation of new or improved 
competency based adult vocational instruc 
tion (Target date September 30, 1977) 

4. Final Report 

This report will contain information 
and supporting data on the status of 
competency based adult vocational pro 
grams sponsored by business, industry, 
lal)or, and education This report v.'ill l)e 
of interest to developers and operators of 
competency^based instruction and also act 
as a readily available resource to all interested 
parties (Target dale, September 30, 1977) 



For additiortai information please con 



tact 



Earl B Ri/ssell, Project Director 
The Center for Vocational Education 
The Ohio^State University 
1960 Kenny Road 
Columbufe, Ohio 43210 



COMPETE/V 




^OIIVDOA, 



^loCAT 



THE CENTER FOR,VOCATIONAL EDUCATION 
"THE OHIO STATE UNIVERSITY 




■loo 



PROJECT 



The Center for Vocational Education, 
under a grant from the U.S. Office of Edu^ 
caiion,.6ureau*of Occupational arid Adult 
Education, is conducting a project to de- 
termine the status of competency-based 
adult vocational education programs. Rel- 
atively little is known about the status of 
these programs in the U.S. Although com- 
munication among teachers and trainers 
of adults is limited, education, business, 
industry, labor, and government agencies 
appear to be increasing iheir efforts in the 
competency-based approach to learning . 
and training. Briefly, competency-based 
programs are defined as being based upQn 
a job/task analysis, performance objectives, 
individualized instruction, and criterion 
referenced testing. Adult vocational pro 
grams include non credit, non-degree skill 
training for out*of»school persons over 
sixteen years of age. 

Major Activities: 

• select and meet with a r^dtional 
Panel of Consultants to resolve 
technical issues 

• develop a set of criteria for 
competency based instruction 

• develop an instrument for survey 
ing.conipeiency based instruction 

• obtain nominations of incjividuals 
or specific agencies to be contacted 

• conduct mail survey of 
competency based progronis identi 
fied 

• on site review of selected progmms 



• compile a National Directory of 
Competency B.ased Adult Voce 
tional Instruction 

• conduct the National Dissemination 
Workshop 



PRODUCTS 



1. Directory 

Thts Directory will be the first of its 
kind available to competency based m 
struction planners in all areas The direc 
tory wilt list programs identified as having 
exemplary competency based adult voca 
tional instruction. The selection of pro 
qrdms to be listed will J>e based on their 
comparison to "textbook" characteristics 
of competency based instruction Each 
Directory listing will include a description 
of instructional components by lob'occii 
pationat title, address, type of organization, 
how competencies are identified, how ob 
lectives iue developed, how instruction is 
structured and performed, and how testing 
IS conducted. (Target date July 30, 1977) 

2. Workshop 

The Center for Vocational Education 
wiU conduct a National Dissemmation 
Workshop during whicli programs and con 
cepts of competency based adult vocational 
instruction will be shared and exchanged 
This will give developers of adult vocational 
programs the opportunity to be further 

(continued on back) 
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\- THE CENTER FOR VOCATIONAL EDUCATION 



The Ohio State University • 1960 Kenny Road • Columbus, Ohio 43210 
Tel: '614) 486-3655 Cable: CTVOCEDOSU/Columbus, Ohio 




FOLLOW-UP REQUEST!! 




About two weeks ago, we sent you materials regarding the National Survey of 
Competency-Based Adult Vocatior.dl Instruction , This is a reminder for you to 
complete the survey if you have not already done so, or to check with your/ staff 
if you routed the material, (If the survey has been completed and mailed/ please 
disregard this note. ) 

We would like to hear from your organization in order to identify exemplary 
competency- based adult vocational programs. Competency-based instruction is 
viewed as a promising means of improving adult vocational instruction. This 
survey is important in assembling information about competency-based programs 
and disseminating that information to program developers and operators. 

Information about competency-based programs is being collected from /selected 
personnel in education, business/industry, labor, and government agencies. We 
want to emphasize that your input is important to tne success of this study. 
Your participation will result in the identification of coinpetency-based adult 
vocational programs, and with your permission, may place a description of your 
training in a National Directory . 

If you are the appropriate person to respond, please take 20 to 30 minutes of 
your time and complete the survey, A complimentary summary of findings will be 
made available to all participants. If you have lost or mispl/aced the survey 
form please write to: Earl Russell, The Center for Vocational Education, The 
Ohio State University, 1960 Kenny Road, Columbus, Ohio, 4^210. 

Thank you for your cooperation and assistance! 



ERIC 
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APPENDIX P 



COMPETENCY-BASED ADULT VOCATIONAL EDUCATION (CBAVE) 

SITE VISITS 



Alabama Tallapoosa-Alexander City Area Training Center 

100 East Country Club Drive 
Alexander City, Alabama 35010 



Contact Person: 

Cal i forn i a 



Florida 

I daho 

Maryland 

Contact Person : 



Johnny H. Spears , 

Radio & TV Repair Instructor 



Charles Nalen 

Vocational Curriculum Coordinator 



Crocker National Bank 
79 New Montgomery Street 
San Francisco, California 9^10^ 

Contact Person: Richard L. Ferrington, 

Vice President & Director 
of Training 

V/oodruff Regional Occupational Center 

302 West Weber 

Stockton, California 95203 

Contact Person: Charles Walejko, 

Division Chai rperson 



Mid-Florida Technical Institute 
2900 West Oak Ridge Road 
Orlando, Florida 32809 

Contact Person: John Palowitch, 

Machine Shop Instructor 



Idaho State University 

School of Vocat ional -Techn i cal Education 
Pocatel lo, Idaho 83209 

Contact Person: Robert W. Simmons 

Machine Shop Instructor 

Harry Lundeberg School of Seamanship 
Piney Point, Maryland 206?^ 
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APPENDIX P CONTINUED 



State Technical Institute & Rehabilitation 
Cen ter 
Alber Drive 

Plainwell, Michigan ^9080 

Contact Person: Robert Leneway, 

Instructional Technology Coordinator 

916 Area Vo-Tech Institute 

3300 Century Avenue 

White Bear Lake, Minnesota 55110 

Contact Person: V/i 1 1 tam V/arner , 

Diree'tor oP Allied Service Occupations 

Suburban Hennepin County Area Vo-Tec Centers 
1820 North Xenium Lane 
Minneapol is , Mirinesota 55^^ 1 

Contact Person: John Kobe, 

Adult Vocational Director 



Northern New Mexico Community College 
St. Vincent Practical Nurse Program 
Santa Fe, New Mexico 87501 

Contact Person: Rosemary Sanderson. 

Program Di rector 
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CBAVE SITE VISIT 



CONTACT: Johnny H. Spears, Radio and TV Repair Instructor 
Tallapoosa-Alexander City Area Training Center 
100 East Country Club Qrive 
Alexander City, Alabama 35010 
Phone: (205) 329-8^^8 

George L. Terrell, Vocational Dcrector 



SCHOOL DESCRIPTION 

Tallapoosa-Alexander City Area Training Center is a three year old 
facility. Serving both Alexander City and Tallapoosa County, this 
area school is principally for 11th and 12th grade high school stu- 
dents from surrounding schools. The regular day program consists of 
300 students and 15 teachers. This school is one of approximately 50 
area vocational centers in operation and another 20 such facilities 
are under construct ior or are funded to be constructed in Alabama. 
About 70 of these area training centers v/i 1 1 be open in Alabama by 
fall, 1977. 

DETAILED PROGRAM DESCRIPTION (RADIO AND TV REPAIR) 

During this past school year there were a total of approximately 
150 adults in the school's adult evening program. In the radio and TV 
repair area, v/hich was a new course in the adult program, there were 1^ 
adults enrolled during the spring session. This adult program in radio 
and TV repair is 72 hours long, meeting in three-hour sessions on Tues- 
day and Thursday evenings for 13 weeks. The instr,uctor keeps progress 
sheets on each student specifying performance objective assignment and 
completion date of the objective. Although Mr. Spears initiated the 
course, Mr. George L. Terrell, Vocational Director, provided administra- 
tive support and Dr. Douglas Patterson of Alabama's State Research Coor- 
dinating Unit and Director of the State's Performance-Based Adult Voca- 
tional Education (PAVE) project invited Mr. Spears to become a partici- 
pant in the project v^hich included workshop training in competency- 
based education for adults. Further descriptive information about this 
program is contained in the National Directory of Selected Competency- 
Based Adult Vocational Education Programs . 

CURRICULUM AND INSTRUCTIONAL MATERIALS 

For the most part Mr. Spears develops his own instructional ma- 
terials for this course in conjunction v/ith his participation in the 
performance-based adult vocational education project being conducted 
by the Alabama State Department of Education as mentioned above. He 




Uses various commercial textbooks and actual electronic components as 
resources to support the curriculum mater iais he developed. Using the 
V-TECS catalog for the occupation, he rearranged the order of the 61 
performance objectives from a simple to complex order for trouble- 
shooting or servicing. He then developed "instructional planning 
bheets'' containing (1) necessary knowledges and skills, (2) learn' ^ 
activities, (3) resources^ — media and materials, and (A) student progress 
check notes. 



STAFF TRAINING IN CBE • 

Mr. Spears has been teaching for three years after several years of 
practical experience in the occupation. He was trained in the area him- 
self in the U.S. Air Force and was later an Air Force instructor of new 
students in electronics from 196A-68. After he became a teacher, he 
was a participant in a v/orkshop sponsored by the Alabama State Depart- 
ment of Education on competency-based education for high school students 
in 1975- Thjs v;as a four-day v/orkshop. Most recently, he was a par- 
ticipant in a two-day workshop sponsored by the Alabama State Depart- 
ment of Education v/ithin the performance-based adult vocational edu* 
cation project under che 'direction of Dr. Douglas Patterson. This 
workshop was conojcted December 9^10, 1976. Mr. Spears indicated his 
rationale for choobing the competency-based education approach in his 
teaching was that education is moving tov;ard CBE and he *'wants to get 
a head start." 



STRENGTHS 

As far as placement and follov;-up are concerned, the program is 
too new as part of the experimental PAVE project to have information 
on adults v;ho finished the program. In general, however, area electron- 
ics firms request students from the program at a rate higher than the 
number of students being trained in the program. Employer files are 
being maintained for subsequent follow-up after sufficient time has 
passed to provide meaningful follov/-L«p Jata. Curriculum materials 
which were developed in the PAVE project ai^e being used with I Uh 
and 12th graders in the regular day program. Thus the adult program 
has had some positive spin-off benefits to the regular program of the 
school. Also, Mr. Spears indicated that the course is easy to teach 
once the instructional materials are developed. 



LIMITATIONS 

The development of instructional materials for each task and per 
formance objective is time consuming. It is estimated that it takes 
approximately one hour to develop instructional materials for each 
tasK. He feels a standard list of reference materials for the course 
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are needed, keyed to the performance objectives. 



GENERAL COMMENTS 

Mr. Spears is one of the teachers in the "experimental group" 
in the PAVE project, sponsored by the U.S. Office of Education under 
a Part C project to be completed on December 31, 1977- The experi- 
mental group to which Mr. Spears belongs has been provided both 
a V-TECS catalog plus two-day workshops in their appropriate use. 
The other experimental group in the project received a V-TECS cata- 
log only and were simply asked to teach the course using the 
catalog. The course described here was taught under formal agree- 
ment with the State Department of Education between January and June, 
1977; the course is to be taught again between July and December, 1977, 
as part of the PAVE project. 




CBAVE SITE VISIT 



CONTACT: Mr. Richard L. Ferrington 

Vice President and Director of Training 
Crocker National Bank 
79 New Montgomery Street 
San Francisco, CA 3k\0k 
Ph: (AI5) 983-3297 



ORGANIZATION DESCRIPTION 



Crocker National Bank has 11,000 employees whiich makes it the 
5th largest bank in California and the 12th largest in th^ United 
States. There are -350 branches statewide. The state is divided 
into seven districts with approximately 50 branch banks per district. 
The bank is organized into two types of divisions: 

1. Five (5) profit making divisions: (California branches, 
Corporate Lending, International Lending, Trust Depart- 
ment: and Corporate Services. 

2. Six (6) staff divisions: Personnel Operations, Public 
Affairs, Marketing, Auditing and Controllers. ; 

J 

Mr. Ferrington is director of a training staff of 23 people, 
located in the bank's administrative center in downtown San Francisco. 
The training staff provides all training and development services to 
the entire bank. These services range from executive development 
programs in the United States and abroad to teller and proof operator 
training in the California branches. 

The training department performs a centralized research, analysis 
and design function providing de-centralized training programs to 
each of the divisions. 



DETAILED PROGRAM DESCRIPTION (COMMERCIAL LENDING) j 

t 

In order for a bank employee to enroll in Commerq'ial Lending l,j 
course prerequisites in basic accounting and financial analysis are re- 
quired. In Commercial Lending I there are 15 units or modules of study 
and practice, and a I6th unit on "Assuming on-the-job Responsibilities." 
An employee typically can complete the first 15 modules in 8-12 weeks. 
These modules are completely open entry/open exit and employees progress 
generally within the time range indicated based on their capabilities 
and time requirements. The I6th unit on "Assuming on-the-job responsi- 
bilities" operates over a fixed time period of 8 weeks for all learners. 
The program began March I, 1977, and by the end of December, 1977, all 
of the bank's 807 commercial loan officers will have been certified in 
Commercial Lending I. This competency-based program was initiated by Mr 
Ferrington, who is an advocate of Robert Mager's approach to Competency- 
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Based Instruction. Course managers are available at each branch bank 
at set tires, normally near the end of the working day. These course 
managers are concerned primarily with testing and student observation 
as they proceed through modules on the job during training. Another 
type of member of the instructional team are course advisors who are 
specialists in one or more of the modules under study. A course advisor 
is available for consultation to learners whenever they have difficulty 
with any part of a module. This differentiation of role between course 
managers and course advisors is an important distinction in the organi- 
zation of this competency-based course. Course managers typify the CBE 
specialist, while the course advisor may be regarded as a content spe- 
cialist. As would be expected, novices take more time to complete the 
course in Commercial Lending I than do experienced lenders. Nonetheless, 
the bank nov; requires that loan officers, experienced or not, be certified 
in this course. 

% 

.CURRICULUM AND INSTRUCTIONAL TRAINING MATERIALS 

Course materials are kept primarily in a set of three large loose- 
af notebooks'. There is a ^'learner workbook" which learners keep during 
and upon completion of instruction. In addition, there are two "resource 
notebooks" which are kept at each branch training site for reference during 
instruction and after it is completed. The resource or reference note- 
books contain concept papers, bank policy papers, published articles from 
a number of sources, examples of contracts, and internal bank forms. The 
learner workbook contains similar material which have been highly se- 
lected to present the basic information required in support of the learn- 
ing activities in each module. All three of these notebooks are learner 
materials and there is no separate "instructor guide." It is important 
to note that virtually all instruction occurs in an on-the-job setting 
where a course manager and/or course advisor works directly with the loan 
officers xin servicing actual customers. With this approach, it would there 
fore be inappropriate to use audio-visual materials and equipment in this 
type of on-the-job training setting. Thus, the job aids, guides, forms, 
and other materials provided are precisely the kinds of materials which 
would be used by a commercial loan office^. Further information about 
this program is contained in the National Directory of Selected Compe- 
tency- Based Adu I t Vocational Education Programs . 

STAFF TRAINING IN CBE 

Mr. Ferrington has a background in U.S. Army training program de- 
velopment. Associated with that experience he was employed with t\}e Human 
Resources Research Organization (HumRRO) . He became a training director 
v/ith HumRRO, which at that time was an Army-affiliated R and D organiza- 
tion. Upon leaving the service, he came to Crocker National Bank as 
Director of Training. Mr. Ferrington's staff are all trained at Robert 
Mager's Seminar in San Mateo. They then apply his methodology to their 
curriculum development. This staff trains course managers throughout 
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California. Course managers K-^ere taught v>^hat a course manager should 
do in competency-based instruction via a one-day course using simu- 
lation, role-playing, and discussion. He indicated that this training 
was rather easy because the course managers had been integrally in- 
volveji in the course development process from the outset. The CBE 
approach, vvfas chosen after the bank*s Chairman of the Board hired a 
new training staff. Subsequently Mr. Ferrington got approval to con- 
duct a systematic training needs analysis for the bank. Based upon 
that analysis, the competency-based approach to training became a 
high priority with full backing of the bank*s administration. 



STRENGTHS 

There are 1^ course managers per district and all are bank employ- 
ees in easy commuting distance of each branch. Everything in the course' 
is *'rear'--all instruction consists of on-the-job activity.. The course 
is based totally on Robert Mager*s approach to criterion-referenced in- 
struction, which begins with a detailed job analysis. Crocker National 
Bank employs all the learners taking Commercial Lending I and the bank 
is committed to assuring that all the bank's commercial loan officers 
are. certi fied through the course in the future. 



Limitations 

There is a time constraint on the availability of course managers 
to work with learners when they need help. As was indicated earlier, 
course managers are typically available near the end of the work day 
and therefore may be unavailable to provide on-the-spot assistance when 
a person enrolled in the course confronts a problem at other times dur- 
ing the work day. 
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CBAVE SITE VISIT 



CONTACT: Mr. Charles Walejko, Division Chairperson 
Woodruff Regional Occupational Center 
302 West Weber 
Stockton, CA 95203 

Ph: (209) A66-A8AI 

Donald Robinson, Principal 



SCHOOL DESCRIPTION 

Woodruff Regional Occupational Center, similar to '*area schools" 
in other states, was one of the first regional occupational centers 
opened in California five years ago. At the present time there are 
eight such centers in the state.. The Woodruff Center is a San Joaquin 
County facility administered by the Stockton Unified School District'. 
Fifteen regular high schools and two private schools from eight school 
districts are served b/ The Center. The school serves both I I th and 12th 
grade high scBool students^and adult students. Of the approximately 
1,^:50 total students enrolled, 950 or 70 percent are adults. The total 
student body of the school is approximately 15 percent Black, 2h percent 
Mexi can- American , 5 percent Asian, and the remainder are Caucasian. 
Programs are offered in: Automotive, Business Careers,. Business Machine 
Repair, Cosmetology, Drafting, Electronics, Health Science, Marine t 
Small Engines, Medical Office Assistant, Welding, and Operation and 
Maintenance. 

DETAILED PROGRAM DESCRIPTION (BUSINESS CAREERS) 

The Business Careers program in its present competency-based form 
is about five years old. In addition to Mr. Walejko as Division Chair- 
person, the Division has four full-time teachers and two full-time aides 
v/ho work together in a large classroom area. The classrpom h<3s the 
appearance of an open- I andscape office area which may be found in many 
businesses. In addition, the program has a 'community classroom" teacher 
v;ho visits students on the job after the school program Is completed to 
assist in their transition from school to work and in supervising 
learning activities that cannot be provided in school. This "community 
classroom" teacher works somewhat like the familiar cooperative education 
coordinator. Most students are in the Business Careers program months. 
The two aides in the program are bilingual and they spend a good portion 
of their time working with predominantly Spanish-speaking students. The 
advanced status of competency-based education in this program was 
facilitated by state law passed in 1965 creating Regional Occupational 
Centers and Programs throughout California. Dr, Robert OeBord , former 
Vocational Education Director at the Regional Occupational Center and 
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Director of Adult and Vocational Education at the Lodi School District, 
north of Stockton, provided an early impetus for the initiation of the 
CBE program described here. Strong support for implementing the compe- 
tency-based Business Careers program ^^fas aUo provided by the Bureau of 
Business Education, State Department of Education, in Sacramento. The 
program can give credits and grades to fit traditional high school re- 
quirements for high school students, even though the program is open 
entry/open exit. The individualized approach allows adults and high 
school students to be enrolled at the same time. Mr. Walejko has deve- 
loped this procedure by simply designating letter grades for the vari- 
ous competency levels which students achieve in the program. Job titles 
for which students are prepared in the program include Clerk Typist, 
Receptionist, General Office Clerk, Payroll Clerk, Stenographer, Dupli- 
cating Machine Operator, and Accounts Clerk. Further information about 
this program is contained in the National Directory of Selected Compe- 
tency- Based Adult Vocational Education Programs . 



CURRICULUM AND INSTRUCTIONAL TRAINING flATERIALS 

The curriculum and instructional materials for the Business 
Careers program are highly developed and v^^el I managed. There are three 
categories of competencies in the program, "common core", "office core", 
and "specialty areas" There are 17 competency areas in the "common 
core" and 12 competency areas in the "office core." "Specialty areas" 
usually contain A-5 competencies pertaining to those areas only. For 
example, the stenographer specialty area includes shorthand and trans- 
cription. If pre-testing reveals that a student is not competent in 
the telephone area in the common core, for example, there are eight 
learning packages that must be completed by the student before taking 
the post-test in the telephone area. The packages are kept at an Inven- 
tory Desk which is maintained by a full-time employee. For each perform- 
ance objective, there are careful ly. developed conditions and standards 
of performance specified. In each competency area there also are sheets 
containing instructional ideas and lists of materials which teachers may 
employ in working with students having difficulty in a given competency 
area, or with different methods of learning. When students experience 
no unusual difficulty in selected competency areas, they are free to v/ork 
alone through the appropriate learning packages for the competency. 
Management of this procedure is facilitated by the use of student con- 
tracts v;hich are developed by agreement between student and teacher. 
These student contracts typically cover I-3 competency areas at a given 
time and represent a basis for both student and teacher to monitor per- 
formance. For many of .the learning packages us^d, these are supporting 
audio-visual materials such as audio tapes, slide-tape sets, or film- 
strips for student use. 
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STAFF TRAINING IN CBE 



Mr. Walejko got most of his training in competency-based 
education through workshops provided by the Bureau of Business Edu- 
cation, California State Department of Education. Teachers within 
his department got on-the-job training in competency-based education, 
working closely with Mr. Walejko and with each other, and by also 
attending two, two-day State Department of Education workshops. He 
feels that some of the most important "training" took place by his 
and staff members visiting demonstration sites in California- These 
demonstration sites are supported financially by the State, and 
activities at demonstration sites are carefully structured to assure 
a learning experience for those who participate. One teacher in the 
department was formerly an executive secretary; another has offJxe 
experience plus a Master's degree in business education;^ and a third 
has banking experience plus a Bachelor's degree in business education. 
One of the teacher aides is a former student however both were trained 
on the job by the teaching staff. [ 



STRENGTHS ) 

This program is highly refined and represents an excellent CBE 
model. The major strength pointed out for the program is that it is 
geared to meet the needs of every student and that students may not 
"fail" as is common in a traditional instructional approach. Mr. Walejko 
had taught for several years in a traditional instructional program 
prior to getting involved in CBE in California. He indicated chat he 
has observed dramatic advantages to students in a CBE program as com- 
pared to students in his program prior to 1972. Within the past five 
years over 600 students have been placed from the Business Careers pro- 
gram in office occupations. There is no "placement" program as such; in- 
stead, local business people call the Regional Occupational Center'and 
ask for employees. A systematic student follow-up program is employed 
whereby the school's staff calls each former student on the job at 3, 6, 
and 12-month intervals following initial employment. Students are rou- 
tinely asked for suggestions as to how the instructional program should 
be modified to meet the job requirements they are facing. No hard data 
exist on employer satisfaction, but it is felt that the many calls 
which come to the school requesting students from the program are an 
excellent unobtrusive measure of employers' pleasure with the training. 
Also, Mr." Walejko gets a lot of informal, positive feedback from his 
program's Advisory Committee. 



LIMITATIONS 

The primary limitation currently is that a method has not been 
developed to obtain hard follov;-up data from employers of former stu- 
dents. The school is planning to develop such a follow-up program 
consistent with the requirements of the Education Amendments of 1976. 



GENERAL COMMENTS 



}'t was emphasized that school personnel need t ime to develop a CBE 
program before they can operate. Ideally, Mr. Walejko feels that teach- 
ers should take an entire summer to develop competency-based curri- 
culum, free of other assignments, under the guidance of good resource 
persons to assist them. .Good planning is essential for preparing a CBE 
program. Much paperwork is involved and good typing and duplicating 
capabilities need to be readily available. To develop the commit- 
ment of administrators and counselors, Mr. Walejko feels that struc- 
tured site visits are more effective than workshops. 
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CBAVE SITE VISIT 



CONTACT: John Palowitch, Machine Shop Instructor 
Mid-Florida Technical Institute 
2900 West Oak Ridge Road 
Orlando, Fl 32809 

Pb: (305) 855-5880, ext. 38 

Wi I I iam Murphy, Assistant Director 



SCHOOL DESCRIPTION 



Mid-Florida Technical Institute is an area techn ica I -vocat iona I 
school, accredited by the Florida State Department of Education, 
and operated by the Orange County Board of Public Instruction. In 
addition to vocat iona I -technica I instruction, students may complete ^ 
academic requirements for a high school diploma. Students may also ^ 
receive certificates of proficiency upon satisfactory completion 
of vocat iona I -technica I courses. The Institute offers training in 
some 20 fields and iS ('esigned to accommodate 2,000 full-time stu- 
dents. Although it is basically an adult school, high school seniors 
may begin careers in vocat iona I -techn ica I- areas while remaining en- 
rolled in their own schools. Adult programs offered in the school are 
non-credit, non-degree, except for drafting, printing, and hotel/ 
motel management, which are now accepted for college credit in 
Florida. Adults who are not high school graduates can earn the 
General Equivalency Diploma (GED) at Mid-Florida Tech, but seniors 
from surrounding high schools may attend and earn high school credit 
on a part-time basis, in both academic and vocational areas. 



DETAILED PROGRAM DESCRIPTION (MACHINE SHOP) 

The machine shop course has been prepared to serve three types 
of students: high school students for credit; adults, with or without 
high school diplomai>, who v;ant to prepare for employment; and adults 
employed as machinists who want to upgrade their skills. Although stu- ^ 
dents in the machine shop course range from 1 8 to over 60 years of age , 
most of the adults enrolled are in tineir late 20s or early 30s. The 
machine shop program has been approved by the Veterans Administration for 
training of former mil'tary personnel. Veterans are required by VA regu- 
lations to spend a given number of clock hours in order to be reimbursed 
for training. More specifically, regular non-veteran adult students 
may enroll in the program under no time constraints, adults in the VA 
program must enroll for a two-year, Z, ^00-hour course, or 30 hours per 
week, and credit requirements for high school seniors are that they 
must take 5^0 hours of machine shop during the senior year. Thus, the 
great diversity of students enrolled in the machine shop program has re- 
sulted in a highly flexible and individualized program in spite of 
^arbitrary time requirements v;hich are beyond the administrative control 
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of Mid-Flor ida Technical Institute. Mr. Palowitch is the lead in- 
structor among the three who teach in the machine shop program. Fur- 
ther descriptive information about this program is contained in the 
National Directory of Se lected Competency-Based Adult Vocational 
Education Proqrairs . 

CURRICULUM AND INSTRUCTIONAL^ MATERIALS 

The princip<al type of curriculum materials used in the program 
are individualized Learning Activity Packages (LAPs) which Mr. Palowitch 
has developed for classroom use since vibout 1970. These Learning Acti^ 
vity Packages were in use before V-TECS catalogs became available in 
1975. The Learning Activity Packages had contained a statement of 
"operation*' (which may be defined similar to a task), a specification 
of tolerances or standards for the operation, a list of steps nec- 
essary to achieve the operation, and a list of necessary reference ma- 
terials and equipment needed. The instructors supplement information 
contained in the materials whenever needed by the students. Now that 
V-TECS catalogs are available which contain validated tasks performed 
by encumbent workers in machine shops, Mr. Palowitch is rewriting his 
LAPs based upon the 1 86 performance objectives which are specified in 
the V-TECS catalog. However, the curriculum and instructional mater- 
ials used in the machine shop program are a result of an evolutionary 
process over a period of many years' experience which Mr. Palowitch 
has had in industry. When he worked in industry he used what were cal- 
led "process" sheets, which are similar to the performance objectives 
and performance guides contained in V-TECS catalogs. 



STAFF TR/^INING IN CBE , 

In 1375 the Florida State Division of Vocational Education received 
a federal grant to develop a delivery system for competency-based voca- 
tional education, including both pre-service and in-serv'ce training. 
Mr. Palowitch was initially selected to be one of 50 demonstration tea- 
chers in competency-based education throughout Florida. To date 17 
teachers remain in that "model*' group and Mr. Palowitch is still a mem- 
ber of that group. The 1 7 demonstration teachers meet each quarter to 
work on strategies for material development, program development, and 
in-service training of other staff members. This group began intensive 
training in July, I977> in strategies and techniques for diffusing com- 
petency-based vocational education in Florida. A relatively new teacher 
on Mr. Palowitch's staff is Mr. Charles Casada. Mr. Casada recently 
completed a course at Florida Technological University on curriculum 
development using V-TfCS catalogs as part of his becoming a certified 
machine shop teacher. Mr. Cunningham, Assistant Director of Mid-Florida 
Technical Institute, is the teacher of the course at Florida Technologi- 
cal University on development of competency-based curricula. Mr. 
Cunningham also serves as a resource person to staff members at Mid- 
Florida Technical Institute in facilitating their training and v;ork in 
conipetency-based vocational education. 
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STRENGTHS 



In addition to the technical quality of the machine shop program, 
the unique interpersonal qualit^'es of Mr. Palowitch with both his 
students and staff members represent a great program asset which would 
be very difficult to instill In other teachers. He made reference a 
number of times to the ''personalized'' machine shop program rather than 
an individualized program to emphasize the interpersonal dimensions 
which exist between his students and him. Placement of progrom com-- 
pleters presents no difficulty, since industry needs are greater 
than the number of persons completing the program. Although there are 
relatively few employers of machinists and machine operators in the 
Orlando area, placement, equipment needs, and program content are 
facilitated by each of those employers serving on the program Advisory 
Committee. For the regular adult student, the program operates as a 
resource center with students free to come and go as they please. 



LIMITATIONS 

Related to the strength just inentioned is a corollary lack of 
"control" over students in the traditional school sense. Some of 
the individuals have high absentee rates. However, no student is recom- 
mended for employment unless competency is achieved in the course. 
Another limitation presently is the huge gap between V-TECS catalogs 
and students' work on machines in the shop. There is an immediate 
need to develop corresponding Learning Activity Packages for each V- 
TECS performance objective so that the content of the V-TECS catalog 
can be delivered more directly to students. 



GENERAL COMMENTS 

See the article: John W. Palowitch. "Dump the Project Approach! 
Try the Operation Method. " School Shop , Vol. 3^, No. 7, March 1975, 
p. 37. 
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CBAVE SITE VISIT 



CONTACT: Mr. Robert W. Simmons, Machine Shop Instructor 
School of Vocational-Technical Education 
Idaho State University 
Pocatel lo, ID 83209 

PH: (208) 236-3262 

Harold D. Garbett, Director 

School of Vocational-Technical Education 



SCHOOL DESCRIPTION 

Idaho State University has a total enrollment of approximately 
10,000 students. Established in 1901, the school was first an academy, 
then a technical institute, later a branch of the University of Idaho, 
still later an independently administered four-year college, and in 
1963 became a state university. Originally the school had agricultural 
and mechanical programs and these remain a strong tradition there to 
the present time. The School of Vocational-Technical Education is 
unique in that it offers no degrees. Students of the Technology Pro- 
grams may elect to take Vo-Tech courses for credit tavard a degree in 
the College of Liberal Arts, however. The degree is entitled "Associate 
of Technology" and is a two and cie-half year program. Idaho State 
University also offers a, bacca 1 aureate degree in vocational-technical 
teacher education through the College of . Education. 



DETAILED PROGRAM DESCRIPTION (MACHINE SHOP) 



The competency-based machine shop program is designed to bring 
adult students to entry-level competency in specific machine shop 
occupations. For example, students may be trained for occupations 
auch as machine tool operator, heavy duty machine operator, production 
nachine operator, or general machinist. 

The length of the various programs options are as follows: 

Machine Tool Operator 720 Contact Hours 2A weeks 

Heavy Duty Machine Operator lAAO Contact Hours A8 weeks 

Production Machine Operator \kkO Concact Hours AS weeks 

General Machinist 1920 Contact Hours 6A weeks 

These classes are intended for students who must hold jobs while 
developing careers as machinists. Students may complete A8O hours 
of training by attending class 7i hours weekly between 7-00 p.m. and 
10:^5 P-ni- Students may complete 720 hours of training by attending 
class 30 hours weekly betv;een ^:00 p.m. and 11:00 p.m. The students' 
ages range from recent hiqh school graduates to retires of the Armed 
Services. A variety of ethnic backgrounds are represented. Student 
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enrol iTOnt includes blacks, native Americans, Chicanes, females and 
an engineering graduate from India. 



The competency-based program in machine shop was initiated by 
Mr. Simmons, Mr. Garbett and Mr. Ardell Smiley, Chairman of the Com- 
mercial and Industrial Education Department, as an approach to update 
the course in the I975"76 school year. The program has a lO-member 
advisory committee consisting of eight management representatives and 
two machinists. 



CURRICULUM AND INSTRUCTIONAL MATERIALS 

Organized primarily on the basis of contact hours, the machine 
shop program is organized into 38 "courses'* which represent units or 
modules of instruction. The curriculum outline for each of these in- 
structional segments contains the number of credits, contact hours re- 
quired, prerequisites, course description, basic tasks, and terminal 
performance objectives and a competency evaluation progress chart. 
The major instructional materials for classroom sessions are almost en- 
tirely inst ructor-developed wi th supplementary text, including manu- 
facturers* operation and service manuals for specific machines. Students 
^ must demonstrate knowledge of machine operations and safety practices 
prior to hands-on instruction. "Research Sheets" are used for students 
to individually pursue answers KO a series of open-ended questions in 
each course or unit. References are listed on these Research Sheets 
for students to consult, with directions to complete the questions, and 
return when finished to the instructor for discussion, grading, and 
job assignment. After having areas of weakness diagnosed and correc- 
ted, students carry out machine operations based upon the classroom ses- 
sions. Finally, students are given pencil-paper "Advancement Quizzes" 
which they must complete v/ithout the aid of any reference materials. 
Upon satisfactory completion of the Advancement Quiz and shop exer- 
cises, the student is allowed to progress to the next course of instruc- 
tion. An evaluation of each task, is recorded on each student's com- 
petency evaluation progress chart. Evaluation is on a scale from I to 



Films are used to emphasize safety, and to introduce basic lathe 
S mill operation. Video tapes are used to present drilling, sawing, 
and Carbide turning and milling. Instructors are utilizing Machinery ' s 
Hand Book in development of lesson plans and assignment sheets. All stu- 
dents own a Hand Book. Working blueprints obtained from industry are 
used in drawing and blueprint reading courses. Further information about 
this program is contained in the National Directory of Selected Competency 
Based Adult Vocational Education Programs . 

STAFF TRAINING IN CBE 

The School of Vocat i ona I -Techn i cal Education initially conducted 
a series of v^orkshops on measurable objectives during 1972-75- These 
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workshops have subsequently been developed into courses which are of- 
fered withir the teacher education program in the College of Education 
on campus. All instructors in the School of Vocational-Technical Edu- 
cation are encouraged to take, as part of their inservice professional 
development, what has become a series of interrelated courses. The 
courses are: (l) Measurable Performance Objectives, (2) Curriculum 
Development, (3) Occupational Analysis, (A) Tests and Measurements, 
and (5) Laboratory Orgdnization and Management and. Methods of Teaching 
Vocational-Education. In addition, Ms. EIen<3 Hernandez on the School 
staff is in charge of planning a series of CBE workshops for insfuctors 
in the coming months. Tr*aining efforts, for staff have grown from a 
recognized need to improve traditional job analysis procedures, and 
methods for making objectives measurable. Specific impetus to the 
training grew from Mr. Garbett's attendance at a workshop conducted 
by Robert Mager. He later read Mager's book and v;as comr.itted to neasit 
able objectives In vocational education. Concurrent with these develop- 
ments, Mr. Sinvrons felt that nuch of the course content prior to this 
time was immaterial and that student achievement of competency was un- 
clear. 



STRENGTHS 

The major strengths pointed out for the competency-based machine 
snop program is its great versatility with many student options. Each 
Ltudent can progress at his own rate within reasonable limits. Due to 
the high industry demand for program graduates, there is no formal place- 
ment program. The placeiment rate for the program is approximately 95 
percent. The School operates a computerized follow-up program of former 
students at one and three years after completion. The folIov;-up is 
done in two parts in which students complete Part 1 of the follovrup be- 
fore leaving school regarding where they can be reached in the future, 
and P^rL II, the predominant part of the fol lov;-up effort, after the 
student is on the job. By using this procedure, the student follow-up 
return rate is consistently about 80 percent, which is exceptionally high 
for such studies. Employer satisfaction with p-^ , am graduates is very 
high based on feedback obtained by instructors make individual visits 
to employers to inquire about former student weaknesses in specific 
competencies. 



LIMITATIONS 

The highly individualized nature of instruction and the consequent 
diverse training v;hich takes place in the machine 3hop requires that 
enrollment must not be over eight students for each instructor at one 
time. Mr. Simmons and Mr. Garbett feel that instructional costs are 
greater in the competency-based mode, but that many additional benefits, 
which are difficult to measure, are evident to them from their own obser 
vations and from industry feedback. 
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.CBAVE SITE VISIT 

CONTACT: Mr. Charles Nalen, Vocational Curriculum Coordinator 
Harry Lundeberg School of Seamanship 
Piney Point , MD 2067^ 

PH: (301) 99^-0010 

Ms. Hazel Brown, President 

SCHOOL DESCRIPTION 

The Harry Lundeberg School of Seamanship is the largest training 
facility for deep sea merchant seafarers and inland 'waterways boatmen 
in the United States. The School has developed a pioneering approach 
to education which has successfully integrated vocational training, 
academic enrichment, and trade union responsibility. Named after the 
founder and first president of the Seafarer's International Union, 
the Harry Lundebe.-g School is the product of a unique cooperative 
effort of the Seafarer's Union and the management of privately-owned 
American flag deep sea ships' and inland waterways towboats. The 
School's training programs are sanctioned by the United States Coast 
Guard, and its academic curriculum is accredited by the Maryland State 
Department of Education. Originally, the Lundeberg School maintained 
training facilities in a number of ports throughout the country. How- 
ever, as technology advanced in the industry, it became necessary to 
centralize training acti vi ties, at the present site in 1967- The School- 
is located on the southernmost tip of Maryland, where the Potomac 
River meets the Chesapeake Bay. The number of trainees on campus 
ranges from 200-300 at any one tjme. Trainees are generally on campus 
for three months, taking a variety of vocational courses as well as 
academic courses if they have not completed a high school diploma. The 
School provides training to entry trainees vvi th no prior maritime ex- 
perience and to experienced trainees who are seeking professional ad- 
vancement through the career upgrading program. A complete high school 
equivalency (GED) program is offered, as well as evening self-enrichment 
classes and training, and reading and study skills. 

The campus consists of administrative offices of the school, 
classroom facilities, resident quarters, and dining halls. Vocational 
and academic classas are taught aboard two '^school sh i ps" to approxi- 
mate life in the industry as closely as possible. 

DETAILED PROGRAM DESCRIPTION (BASIC VOCATIONAL EDUCATION AND UPGRADING 

PROGRAMS) 

In basic vocational education, an entry student enrolls in the 
deckhand/tankerman program. This program offers training for the 
deep sea entry ratings and inland towboat deckhand. Entry trainees are 




generally l8-2^ years of age and they come to the School from throughout 
the United States. 

The upgrading program for experienced personnel at the Lundeberg 
School consists of courses for all U.S. Coast Guard endorsements for un- 
licensed ratings in the deck and engine departments. The towboat upgrad 
ing offers training for all ratings and licenses available to boatmen. 
•Non-Coast Guard endorsement programs are also offered in the steward 
department for deep sea cooking or towboat inland cooking. Examples of 
special upgrading programs include Marine Electrical Maintenance, 
Maintenance of Shipboard (Refrigeration Systems, and Pumproom Operation 
and Maintenance. While the basic vocational education program is struc- 
tured around a standard three-month period, the upgrading program for 
experienced trainees provides the option for them to "test out" whenever 
they can satisfactorily demonstrate competence. The Lundeberg School 
works closely with the U.S. Coast Guard in testing, and Coast Guard per- 
sonnel administer the tests at no cost to the School. 



Attention will be focused here on four of the vocational education 
programs at the Lundeberg School. 



. Deckhand/Tanke rman 

. Marine Electrical Maintenance 

. Welding 

. Li feboatman/Able Seaman 



The Deckhand/Tanke rman course is the longest of the four, consist- 
ing of six two-week mini -courses. These are Basic Deck, Lifeboat, Stew- 
ard, Basic Engine, Tankerman, and Advanced Deck. Marine Electrical 
Maintenance includes use and care of electrical instruments, trouble- 
shooting of electrical equipment, and starting, securing, and parallel- 
ing towboat generators. The V/elding program includes instruction in 
both arc welding and oxy-acety lene welding. Li feboatman/Able Seaman is 
actually a sequence of two shorter courses. Lifeboatman includes on-deck 
training in raising and lowering lifeboats and in properly rowing life- 
boats. This skill training portion of the course makes up approximately 
50 percent of its content. The other half of the course. Able Seaman, 
consists of much teacher lecture and discussion to prepare upgraders for 
the Coast Guard examinations. These penci 1 -paper , multiple choice exam- 
inations must be passed in order for trainees to receive appropriate li- 
censing by the Coast Guard. Further information about these four courses 
is contained in the National Directory of Selected Competency-Based 
Adult Vocational Education Programs. 



CURRICULUM AND INSTRUCTIONAL MATERIALS 



The curriculum and instructional materials for two of the courses, 
Deckhand/Tanke rman and Li feboatman/Able Seaman, are developed, utilized, 
and revjised based on regular inputs from advisory committees consisting 
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of industry, Union, and Coast Guard representatives. Cum cuium mater- 
ials used in the Marine Electrical Maintenance and Welding courses 
are developed entirely by the instructors. There is considerable vari- 
ation from course to course, and even within segments of some courses 
in the types of instructional materials used. Generally, across al )' 
courses, constant efforts are made to minimize the time spent in lectur- 
'ing and using printed materials, while maximizing time spent in con- 
ducting demonstrations, discussions, and working with real tools and 
equipment as will be done on the job following training. 

In the Deckhand/Tankerman course, the segments dealing with 
Basic Deck, Lifeboat, Tankerman, and Advanced Deck are taught almost 
entirely outdoors aboard the schoolships and adjacent docks. In the 
Basic Engine and Steward segments of this course, more classroom 
audio-visuals are employed due to the nature of the course content. 
Slides, film loops ,^ fi Ims , and transparencies are used to illustrate 
these concepts. In the Welding course, two programmed textbool^s are 
used. One is Basic A.c Welding and the other is Basic Oxy-Acetylene 
Welding , published by Delmar Publications (Albany, New York). Each stu- 
dent has his own copy of these programmed texts and they are used as 
workbooks whirh the student may keep. Some films are used as a supple- 
ment to these programmed texts. Materials used in the Marine Electrical 
Maintenance course are developed entirely by the instructor who has 
a background in U.S. Navy i nstructiona' systems development. A mobile 
training aid built by the instructor is the predominant audio-visual 
used to teach this course; some Navy films are used as supplements. 
The Li feboatman/Able Seaman course relies almost totally on instructor 
demonstration and hands-on training aboard ship in the Lifeboatman por- 
tion. The Able Seaman portion of this course relies heavily upon printed 
materials in support of teacher lectures as upgraders prepare for Coast 
Guard examinations. 



STAFF TRAINING IN CBE 

Schoolwide leadership in competency-based education has been pro- 
vided by Hazel Brown since she became President of the Marry Lundeberg 
School in 1972. Charles Nalen, Curriculum Coordinator for the Vocational 
Department, anH several of the vocational instructors have received 
training in CBE, development of lesson plans, and development of 
teaching aids, from Dr. Donald Maley, Professor of Vocational Education 
at the University of Maryland. However, most instructor training in CBE 
is done on an individual basis by Mr. Nalen based on his observations 
and consultations with instructors. 



STRENGTHS 



Mr. Nalen indicated that the CBE mode of instruction more effec- 
tively supplies manpower to the industry than traditional programs did. 
Instructors utilize their time more effectively than in previous years 
because they know more clearly the job requirements of industry, and 
the purpose for courses is therefore clearer than before. Since the 
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program is designed to serve the Seafarer's International Union, stu- 
dents' pi acement is automatic in the industry following program comple- 
tion. Fol low-up information is obtained from the employers during 
semi-annual meetings of the SchooTs advisory committee. Information 
on retention rates, performance problems, and changing industry needs 
are discussed. 



LIMITATIONS 

A difficulty experienced at the School is the conflict between 
the competency-based approach, which the School is effectively imple- 
'jnenting, and the traditional pencil and paper tests required for li- 
censing by the Coast Guard. The staff indicated that the Coast Guard exams 
frequently contain items which are obsolete, but which students must 
learn in order to pass the tests. Coast Guard exams are not criterion- 
referenced except in navigation where they contain a few plotting ex- 
ercises. The tests are otherwise multiple choice. The Harry Lundeberg 
School would prefer competency testing, but it is very unlikely that 
this will occur in the very near future by the Coast Guard. 



GENERAL COMMENTS 

The instructional program at the Harry Lundeberg School of Sea- 
manship is indeed unique and of exceptionally high quality. The School 
has excellent management, professionalism throughout the staff is very 
high, and students are obviously interested in and involved actively in 
the learning process. 




CSAVE SITE VISIT 



CONTACT: Mr. Robert Leneway , Instructional Technology Coordinator 

State Technical Institute and Rehabilitation Center (STIRC) 
Alber Drive 
Plainwell , Ml A9080 

PH: (616) eei^-kkS] 

Mr. Leonard W. Lee, Director 

Mr. Del Anderson, Supervisor of Instruction 



' SCHOOL DESCRIPTION- 

The Institute lies near the center of the Kalamazoo, Grand Rapids, 
^'Battle Creek triangle and is located 10 miles northeast of Plainwell 
at Pine Lake. The primary purpose of the Institute is to conduct voca- 
tional and technical training programi and provide the supportive ser- 
vices needed to prepare Michigan's disabled adults for successful en^ploy- 
ment. T+ie school is part of the Vocational Rehabilitation Service of 
the Michigan Department of Education and it is approved by the Veterans 
Administration. The campus houses living and training facilities for 
all single students. Currently there are approximately kOO students 
in training, ranging in age from 17 on up. The school receives 
approximately $2 million in State Vocational Rehabilitation funds per 
year. It is classified as a comprehensive rehab i 1 ijtat ion center. The 
school has U training departments, auto mechanics being one of them, 
which provide training in S6 occupational areas. In addition, there is 
a Learning Technology Department which serves the various training de- 
partments. . The Director of the Institute supervises the divisions of 
Instruction, Support Services, Medical, and Business Management. There 
are 37 trade and related instructors in the school. Ninety-five per- 
cent of the students are disabled (orthopedic, personality disorders, 
hearing impaired, visually handicapped, etc.). The Vocational Rehabili- 
tation Service supports 92 percent of the students at the Institute; 
93 percent are males; 15 percent are minority students; and 60 percent 
are high school graduates. 

DETAILED PROGRAM DESCRIPTION (AUTO MECHANICS) 

The auto mechanics program operates under a school -wide com- 
petenpy-based education approach coordinated by Mr. Robert Leneway. 
The competency-based approach is relatively new in the Institute and auto 
mechanics is the training department in which CBE is most com- 
pletely implemented. Students may enter the competency-based auto 
mechanics program at almost any* time. The CBE system at Capitol Area 
Career Center in Mason, Michigan, is being used as the model for pro- 
gram adaption at the State Technical Institute and Rehabilitation Cen- 
ter. The auto mechanics job analysis and supporting curriculum mate- 
rials were obtained from Capitol Area Career Center and were adapted 



127 



for handicapped adults based upon suggestions by Advisory Council mem- 
bers, school administrators, and instructors. For Auto Mechanics there 
are three "Certification Levels" which students may achieve in a given 
performance objective: 1= no time limit; 2 = flat rate plus 50 percent; 
and 3 = flat rate or less. Examples of occupational areas (within the 
Auto Mechanics Training Department) included are Front End Specialist 
and Brake Specialist. The Institute's academic programs in reading and ' 
math are strictly remedial Further information about this auto mechan- 
ics program is contained in the National Directory of Selected Competency- 
Based Adult Vocational Education Programs. \ 



CURRICULUM AND INSTRUCTIONAL MATERIALS 



Instructional modules are in use which are supported by slides, 
tapes, filmstrips, filrh loops, etc., in a highly mediated learning re- 
sources center adjacent to the auto mechanics shop. To be successful, 
students must know how to read - A new Vocational Reading Competency- 
based Support program is being implemented to assist students with the 
reading prerequisite. Problems are detected by testing students on tasks 
in the shop. The modules psecify performance objectives,, the "givens" 
or conditions under which the objectives must be performed, and criterion 
of success whi.ch is often based on the time required to achieve the ob- 
jective. All instructional materials were developed from prototypes 
obtained from the Capitol Area Career Center. Management of curriculum 
and instructional materials is done in part by use of "prototype lists" 
which contain module numbers, titles and objectives. 



STAFF TRAINING IN CBE 



The curriculum consultants from the Capitol Area Career Center have 
worked closely with the auto mechanics staff to work out problems v/ith 
the competency-based instructional materials. In addition, consultants 
have held tv;o wbrkshops for Institute staff on (1) task analysis, and 
(2) the modularized, competency-based system. Following these workshops, 
these selected staff members who were trained, visited Capitol Area Career 
Center to observe the competency-based program in operation there. Subse- 
quently, a committee consisting of the tv/o auto mechanic instructors, 
Paul Henke and Jack Trumbla, Department Counselor, Robert McAllister, 
School Director, Leonard Lee, Instructional Supervisor, Del Anderson, and 
Project coordinator Robert Leneway, met on developing a competency-based 
automotive education pr^ogram and establishing procedures for -implement ing 
the system at the State Technical Institute and Rehabilitation Center ^ 
(STIRC). Subsequently, modules were selected for use and were modified 
to fit the Institute's equipment and disabled adult population. The Cap- 
itol Area Career CenteV clusters their automotive offerings as follows, 
Heavy Mechanic, Light Mechanic, Service Station Attendant, Tire and 
Exhaust Specialist and Diagnostic Specialist. V/here the State Tech- 
nical Institute CBE committee chose to cluster modules around the Na- 
tional Institute for Automotive Service Excellency Cerf i f ication categor- 
ies. Passing the N.I.A.S.E. or the Michigan Motor Vehicle Mechanic Program 
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exams bccan>e the Icr'-inol objectives for each of STIRC prototype 
clusters. It was felt by the CBE committee that this would allow for 
STIRC disabled adults, while maintaining quality training standards. 
In addition to specific CBE training, both the auto mechanics de- 
partment head and the auto machine shop instructor have had approxi- 
mately 20 years of experience in the industry prior to teaching. 



STRENGTHS 

A driving force behind the success of this competency-based effort 
is the administrative support and leadership given to the teachers. 
One of the primary reasons the scnool administration chose to begin CBE 
in auto mechanics was that the instructors were, viewed as being among 
the most v/i I ling to implement new instructional approaches. There is 
a move toward school-wide CBE, and the administration is considering man 
dating CBE in all training areas in the next two years. In addition to 
a statewide institutional advisory committee, there is an advisory com- 
mittee for each occupational program. These committees meet 1-2 times 
per year as a group. The job placement rate of program completers 
is approximately 95 percent across all programs*. 



LIMITATIONS 

Open entry/open exit CBE creates problems in administration and 
certification. Also, keeping module support materials organized has 
been difficult; however, a person has been employed to help in main- 
taining material organization. 

GENERAL COMMENTS 

The Institute has a five-year goal to implement an "open enroll- 
ment" concept. If this goal is achieved, CBE would be a school-wide 
requirement. Under this open entry-open exit system students would 
be able to enroll as a program opening occurred and exit when they have 
completed as many task modules as they are capable of or are interested 
in mastering. STIRC fee lb that if enrollment can be more stabilized 
with an open entry/exit system, then the relative cost per enrol lee can 
be reduced and more severely handicapped students can be served. It is 
anticipated that a CBE system is the most appropriate process for attain 
ing this goal . 
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CBAVE SITE VISIT 



CONTACT: Mr. William Warner, Director of Allied Service Occupations 



916 Area Vo-Tech Institute 
3300 Century Avenue 
White Bear Lake, MN 551 10 
Ph: (612) 770-2351 

Mr. Patrick T. Gerkey, Lead Instructional Developer 



SCHOOL DESCRIPTION 

The Area Vo-Tech Institute (AVTl) is an operating post-secondary 
part of Special Intermediate School District 916 which serves nine 
lo^al school districts. District 916 also operates a shared time 
vocational center for 1^ senior high schools and extensive adult part 
time antl' extens ion vocational training. Any postsecondary or adult 
student in the state can attend the Institute. Special reciprocal pro- 
visions are available for Wisconsin and other bordering states. Other 
out-of-state or International students may attend on a full-cost basis. 
High school and postsecondary students participate in the same vo- 
cational programs because the competency-based, individualized instruc- 
tional program is operational throughout the school system. The Insti- 
tute was opened in 1972 under the leadership of its present Superinten- 
dent, Dr. William C. Knaak. There are 188 teachers in the school, and 
7''9>000 annual enrollments, including 5,500 in the adult evening pro- 
gram. Soon after the school opened, the School Board adopted a policy 
requiring that at least 20 percent of the training slots be available to 
disadvantaged and handicapped persons. The school has effectively 
committed itself to that goal, and presently 30 percent of the day stu- 
dents are classified as disadvantaged and handicapped. 

DETAILED PROGRAM DESCRIPTION (Personalized Vocational -Techni cal 

I nstruction) 

The CBE program in operation at this Institute is uniformly and 
effectively appl ied across all courses taught in the school. The CBE 
program was designed and developed before the school opened in 1972. 
The adult program at the Institute utilizes essentially the same CBE 
curriculum materials which are used in the postsecondary school pro- 
gram. Materials are developed by the daytime staff and are utilized by 
the adult evening instructors, many of whom are part-time instructors. 
Approximately 75 percenL of the adult enrol lees come to the Institute 
to upgrade their skills within an existing employment setting. Most 
of the other adults enrolled enter to be retrained, and many are mid*" 
career women.. The age range of adult students is from 1 7-60s , with 
most being in their 20s. As far as the sex stereotyping problem is 
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concerned, the school is experiencing more success than most Vo-Tech 
f nsti tut ions in get^ting women into traditionally *'male'* occupations 
than vice versa. 916 AVTI has the records highest minority race en- 
rollment in the state Vo-Techs and the highest retention record. 

There are four Directors of Instruction (Mr. Warner is one of 
/ them) who report to Chris Schlegel who serves as both Assistant to 

the Superintendent for Instruction and as Director of the Area Voca- 
tional Technical Institute. The four directors of Instruction ^have 
a staff relationship with the Director of Adult Extension and Part- 
time training. Teachers in the program are hired . based on their occu 
pational experience, with supportive professional education training. 
All daytime programs in the school are on-going throughout the year 
without quarterly or semester breaks, v;hile the adult evening pro- 
gram is organized into four quarters per year. Programs are monthly 
entry/open exit and the person whose name is at the top of a wait- 
ing list, is allowed to enter as scon as another student completes 
or leaves the program. The school refuses no one from a program of- 
fering. Further information about this program is contained in the 
National Directory of Selec t ed Competency-Based Adult Vocati onal 
Education Programs > 



CURRICULUM AND INSTRUCTIONAL TRAINING MATERIALS 

Curriculum development begins by developing a list of job tasks 
with the assistance of Advisory Committees in specific occupations. 
A "Learning Guide" is then prepared for each job task which is a series 
of directives to take the students through the learning process. The 
format of the Learning Guide is standardized and is in use throughout 
the Institute. Learning Guides have a statement of the task and its 
purpose printed on the cover along with department, program, task, and 
prerequisite codes. Inside the Learning Guide is a space for studen t 
da ta , the terminal performance objective is stated, micro-performance 
objectives are listed next, followed by an agreement whereby the stu- 
dent and instructor sign a statement indicating the performance and 
time agreement reached between the two. This agreement becomes the 
basis for reporting the student's competency and for recording progress. 
The next page of a Learning Guide contains a statement of the first 
micro-performance objective and provides the student with learning 
steps and resources necessary to ^^ccomplish that objective. Information 
sheets are provided for each micro-performance objective listing such 
items as tools, equipment, raterials, and explaining buch things as pro- 
cedures and techniques necessary for the performance. The last page of 
the Learning Guide contains a Performance/Product Checklist on which the 
In^ilruCtor evaluate? che quality of the student's performance. Instruc- 
tior^s are provided in the Learning Guide for students to contact the 
instructor when they'feel competent to have their performance evaluated. 

Thus the Learning Guide is a short, concise document v;hich lists 
all the steps necessary to complete an objective and specifies the nec- 
essary resources such as information sheets, sound-slide sets, videotapes, 
texts, etc. Each department in the school has its own Learning Resource 
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Center where students may easily obtain the resources specified in the 
Learning Guide. Criterion tests are used as part of the learning 
steps and are not used just as a 'TinaP' test of competence. The "Per- 
formance/Product Checklist" contains multiple criteria for evaluating 
the psychomotor skills of a terminal performance objective. The 
"product" is the performance which is to be done. No resources may be 
used with the checklist unless the same resources are used as a part 
of the normal job performance. 



STAFF TRAINING IN CBE 

The Institute uses a teacher training program developed in-house 
for instructors in both the day and adult evening programsv. The teacher 
training program is also competency-based in a similar format to other 
CBE curriculum materials in the Institute. The teacher training program 
consists of seven. units or modules which include: 

1) Working at 916 Vo"Tech Institute 

2) Becoming an Instructor 

3) Using the Personalized System of Instruction 

k) Designing Self-Paced Curricula for the Personalized System 

5) Selecting and Designing Resources 

6) Developing Evaluation Instruments 

7) Revising the Curriculum 

This competency-based teacher training program is sel f -.ins t ruct ion- 
al for the most part. Although the Institute has a half-time teacher 
trainer on the staff (it is anticipated that this will be a full- 
time position by fall, 1977), the teacher trainer is not needed as 
much on the first three units. The teacher trainer's time is required 
to a considerable extent in the last four units.^ v The teacher trainer 
does work with all units to some extent and the units (modules) are de- 
signed in that way. One of the major inputs to the design of the 
Institute's teacher training program was the performance-based teacher 
education modules developed by The Center for Vocational Education, Ohio 
State University. Teachers are trained to focus on the "end product" 
(student performance) to better meet industry needs. 



STRFNGTHS 

A major strength, referred to earlier, is th^t no student is re- 
fused entry into programs at the Institute; the CBE programs are highly 
individualized and are monthly entry/open exit. Other strengths pointed 
out were that the consistency and systematic approach are applied through 
out the school by instructors and supervisory staff. Instructors can 
see tangible progress among students, and support services in the In- 
stitute are particularly strong with instructional design, media, 
materials production, and assistance with individual students* problems. 




LIMITATIONS 

At present the adult part-time and extension vocational program 
does not utilize a systematic placement and follow-up program for 
those who complete or leave as is provided for full time postsecond- 
ary students. However, such a program is being planned, consistent 
with the requirements of the Education Amendments of 1976. Another 
limitation in the adult vocational program is that shorter modules 
are needed in some courses. Unlike the daytime progr'am, the adult 
evening program is structured into a fixed time frame, generally in 
nine-week quarterly blocks. This quarterly blocking approach is pri- 
marily utilized in order to facilitate the short-term employment of 
part-time evening instructors from local businesses and industry. How- 
ever, the monthly entry/open exit concept is applied at the performance 
objective (or task)level, allowing for a high degree of individuali- 
zation within the course. 



GENERAL COMMENTS 

§ee a text co-authored by Dr. Knaak: David J. Pucel and William C. 
Knaak. Individual izing Vocational -Technical Instruction . . Columbus, Ohio: 
Charles Merrill, 1975. 



CBAVE SITE VISIT 



CONTACT: Dr. John Kobe, Adult Vocational Director 

Suburban Hennepin County Area Vo-Tec Centers 
. District Office 

1820 North Xenium Lane 
Minneapol is, MN 55^^I 
Ph: (612) 559-3535 

Dr. Richard Emery, Superintendent 



SCHOOL DESCRIPTION 

Suburban Hennepin County Area Vocational-Technical Centers, Inde- 
pendent District No. 287, consists of a north campus, a south campus, and 
a district office which centrally located between the tv;o campuses. 
The school serves a largf metropolitan area west of Minneapolis. The 
school covers 13 suburb^^^n school districts and Ik high schools. Most of 
these high schools provide vocational programs as well. Independent 
District No. 287 covers the largest geographic area among the 3^ vo- 
cational-technical centers in Minnesota. This school district is the 
second wealthiest in the United States. When the school began oper- 
ation in 1970, the adult evening program was the first to become opera- 
tional. In addition to vccat ional -technical programs, the school does 
all the special education for each of the 13 school districts covered 
by the Suburban Hennepin County Vocat iona I -Techn i ca I Centers. 

DETAILED PROGRAM DESCRIPTION (Adult Vocational Education) 

The adult vocational program is non-credit and non-degree and is 
operated separately from the secondary and post secondary programs which 
are conducted during the day. The adult program operates from 6-10:30 p.m. 
on a quarterly basis year-round. In the preceding four quarters (1976- 
77) the adult vocational program employed 65O instructors on a part- 
time basis and enrolled 22,000 adult students. The school operates 
"tailor-made** training programs for area businesses and industries, and 
these programs comprise ^0-^5 percent of the student enrollment. Grades 
are not employed in the program, but diplomas are awarded upon program 
completion which certify the competencies achieved in the course taken. 
Advisory Committees review each program four times a year. Advisory 
Committees are heavily involved in programs and the school purchases no 
equipment without Advisory Committee endorsement. Dr. Richard Emery, 
Superintendent of Independent District No. 287, started the competency- 
based concept v/hen the school opened, and he led this movement v/ith the 
full support or the School Board. Dr. Kobe was the District's fnurcn 
employee hired. Dr. Emery, Dr. Kobe, and others traveled* throughout the 
United States and part of Canada examining learning activity packages. 
Subsequently, the school administration developed a structure for learning 
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activity packages, called "PAKS," throughout all programs in the school 
system. Since many of the'adult vocational teachers are part-time in- 
structors from local businesses and industries, heavy use is made of the 
competency-based curriculum materials developed for use within the 
regular day program. Due lo administrative leadership and manage- 
ment procedures, the format for specifying performance objectives, de- 
veloping PAKS, and supporting learning materials Is consistent across 
all programs and courses throughout the school system. There is a strong 
administrative commitment to CBE in the school. 



CURRICULUM AND INSTRUCTIONAL TRAINING MATERIALS 

All full-time teachers in the regular day program of the school work 
an eight-hour day. When teacher's are not in class, they have responsi- 
bility for wr:ting new or revising existing curr i cul um mater ia 1 s in the 
prescribed CBE format. This has been a continuous development process 
for the past five years. A large volume of materials has been developed 
over this period and they are used routinely in the adult vocational pro- 
gram. Instructors themselves are primarily responsible for developing 
PAKS. Although the type of learning resources varies from .course to 
course depending upon its content and the aval labi 1 i tyjof support 
materials. Resources include textbooks, videotapes, sffde-tape sets, 
audio tapes, information sheets, and worksheets. A large number of 
classes utilize videotape cassettes. The school is incfreasing its use 
of sound-on-sl ide sets because of their great flexibility and ease of 
revision. Program Advisory Committees and content specialists on the 
staff regularly review and suggest revisions as a means to quality control 
of instructional materials, Further information ahout this program is con 
tained in che National Directory of Selected Corr sncy Based Adul t 
Vocational Education Programs . 

STAFF TRAINING 11! CBE 



Adult vocational teachers who use the competency-based learning 
PAKS in their evening courses are required to take a pre-service train- 
ing unit v;hich is based upon a PAKS "training package.'* In this way, 
teachers are trained by a procedure which they are expected to employ 
in their classrooms. This pre-service training is a requirement for 
state certification and is also necessary yfor incremental advance on 
the teacher salary schedule. In addition, there are four in-service 
teacher training sessions v;hich are offered for three hours, one night 
per week, for four v;eek5 (or a total of 12 hours), and these sessions 
are conducted successively so that a teacher may enroll in all of them. 

The pre-service teacher training unit lasts for 30 hours <ind in- 
cludes teaching methods and orientation to the school's competency-based 
education delivery system. The four 12-hour sessions of in-service 
teacher training include (1) job and task analysis, (2) individualiz- 
ing instruction based on task analysis, (3) effective use of learning 
hardv/are including the various types of audio-visual equipment, and 
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(k) student evaluation and the psychology of adult learning. Dr. Kobe 
recently completed his Ph.D dissertation at the University of Minne- 
sota on the subject of competencies needed by adult vocational fn- 
structors. 



Dr. Kobe gives major credit to the school's progress in com- 
petency-based educat io to its Superintendent, Dr. Richard Emery. There 
.^js a strong irst i tutional cooxiij tment to CBE. All profess iona 1 staff of 
the schoo' are expected to perform in the CBE framework. More specifi- 
cally, strengths i n::l ude: 

(1) The program lends itself well to training for specific in- 
dustry needs. Competency lists already available at the school make 

a good starting point in discussing curriculum cont>en£ needs v;ith indus- 
try personne 1 . 

(2) The program can be adjusted easily to the base differences in 
the aduUt population served. Competency-based education and indivi- 
dualized instruction go hand-in-hand in the school. 

(3) The program is compatible with the problems of the adult 
learner For example, if an adult must miss class due to babysitting 
problems, or any other reason, a person does not "fall behind" in the 
course, but rather continues to work on the competency being pursued 
prior to an absence. 



LIMITATIONS 

The placement program for program completers is quite li.niited, pri- 
marily because most adults enrolled in the evening program are already 
employed. People who arc unemployed and who complete a vocational course 
have primary responsibility for obtaining their ov;n jobs. "Also, no for- 
mal folio, -up program of adults who complete or leave adult vocational 
courses is in operation. Occasionally, informal reports are rfxeived 
from former students or their employers. 

GENERAL COMMENTS 

This program is one of the most comprehensive, highly developed, 
and well managed in the United States. There are a large number of 
adult vocational courses v;hlch are operating at present under a stan- 
dardized competency-based education delivery system. The administra- 
tive commitment to make a program of this size Vifork ,so well Is unusual 
by the present state of the art in CBE. 
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CBAVE SITE VISIT 



CONTACT: Ms. Rosemary Sanderson, Program Director 
St. Vincent Practical Nurse Program 
Northern New Mexico Community College 
c/o College of Santa Fe 
Santa Fe, NM 87501 

PH: (505) 982-652^ 



SCHOOL DESCRIPTION 

Northern New Mexico Community College was so named, effective 
July I, 1977. Prior to that time the school was named New Mexico 
Technical Vocational School. The school is located on the campus of 
the College of Santa Fe , although the administration of Northern New 
Mexico Community College is completely separate from that of the College 
of Santa Fe, and buildings occupied by the Community College ai'e rented 
from the College of Santa Fe. The Community College offers 15 vocational 
programs leading to one-year certificates. Examples of these programs 
include typing, shorthand, meat cutting, distributive education, carpen- 
try, auto mechanics, auto body repair, appliance repair, dental assis- 
tant, and the practical nurse program. In addition, the Community 
College offers a two-year program leading to an associate degree in 
liberal arts. Approximately 500 students are enrolled in all programs 
of the Community College. Students come from throughout northern New 
Mexico and they are predominantly tri -cul tural : Anglo, Spanish-American, 
and Native American. 

DETAILED PROGRAM DESCRIPTION (PRACTICAL NURSING) 

The practical nursing program was originally hospi tal -based, 
beginning in 19^9- The program has been located on the campus of 
Northern New Mexico Community College since spring, 197^. Rosemary 
Sanderson initiated the competency-based education emphasis as a re- 
sult of a CBE workshop conducted in summer, 197^ > sponsored by the New 
Mexico State Department of Education. The St. Vincent School of Prac- 
tical Nursing in its present competency-based format has been in exis- 
tence since summer, 197^. At that time the competency-based practical 
nursing program was built heavily upon a study conducted by Lucile A. 
Wood, "UCLA Allied Health Professions Project--Nurs ing Occupational 
Report." This report was used to identify nursing tasks which became 
the basis of performance objectives for the program. Later a project 
funded by the W. K, Kellogg Foundation at the University of Albuquerque 
entitled "New Mexico SNAP Project: Systems for a Nursing Articulation 
Program," established minimum behavioral expectations which beginning 
practitioners are expected to perform in several categories of nursing 
competencies. The purpose of this three-year project is to design. 




implement, and evaluate a state-wide articulated system of nursing 
education, and one goal of the SNAP project is to have all nursing 
education programs in New Mexico offered in a competency-based format. 



Students in the St. Vincent School of Practical Nursing range 
from 18-55 years of age, with most in their late 20s. Approximately 
35 students are enrolled in the program each year, and they come from 
the Work Incentive (WIN) program, CETA, and Veterans Administration* 
programs. Spanish-Americans make up approximately one-third of the 
students in the program, often there are 2-3 American Indian students, 
and the remainder are Caucasian. Further information about this prac- 
tical nursing program is contained in the National Directory of Selec- 
ted Competency-Based Adult Vocational Education Programs . 

CURRICULUM AND INSTRUCTIONAL MATERIALS 

From the beginning of the conipetency-based program in 197^ 
until early 1977> the primary curriculum materials in use were modules 
developed from the study by Wood r UCLA, cited above. Beginning in 
fall, 1977> a change is being mad*, o commercially produced curriculum 
materials published inVthe document. Modules for Basic Nursing Skills , 
by Ellis, Nowlis, and BJuitz (Boston: Houghton Mifflin Co., 1977)- 
(Note to the reader: I t \was noteworthy that this program in practical 
nursing is the only one among the si^e visits conducted in this USOE 
project in which commerci aiNy-produced curriculum and instructional 
materials are in predominanui use. All other sites visited relied very 
heavily on materials developed by instructors locally, sometimes supple- 
mented by commercial materials.) In addition to the published modules 
in current use and the modules previously used as well, many filmstrips, 
slides, films, and other audio-visuals are used to supplement the curri- 
culum modules. 



STAFF TRAINING IN CDE 

In 197^ Lucile Wood conducted a CBE workshop in the "Career Mobility 
Project" sponsored by the Nev/ Mexico State Department of Education. This 
workshop, based largely on the work of Robert Mager, was a major impetus 
to Ms. Sanderson in initiating her competency-based nursing program. 
Subsequently, the SNAP project conducted several workshops for nursing 
education personnel in New Mexico. These workshops deali largely with 
the formulation of behavioral objectives, development of related learn- 
ing activities, design of mastery assignments, and competency-based 
course management. To supplement these workshops, the Health Occupa- 
tions Education Coordinator in the State Department of Education worked 
with several staff members at the school in implementing the CBE con- 
cept. In addition, during the spring of 1977> the State Department of 
Education conducted a workshop on development of performance objectives 
and associated curriculum development activities. 
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The CBE concept was chosen for this practical nursing program for 
several reasons. First, the New Mexico Career Mobility program has 
called for certification of competency at each of the nursing career 
levels. This effort is part of a move toward establishing upward 
mobility to the associate degree level with minimal repetition and 
loss of time for the student. Second, the CBE concept "made a lot 
of sense" to Ms Sanderson, and her leadership appears to have been 
critical to the development of this particular program. Third, 
leadership personnel of the New Mexico State Department of Educa- 
tion in general have been encouraging the use of measurable perform- 
ance objectives throughout all vocational programs in the state. 



Curriculum modules used in the program allow students to work 
at their own pace, within a framework of reasonable limits. Students 
have three opportunities to achieve mastery in a gi'ven competency, based 
upon the mastery testing activities. Another strong and very unique 
feature of this program are the follow-up activities conducted among 
former students and employers. The student follow-up program has 
been conducted since the program began in 19^9» and is conducted among 
students who have been out of the program for one and five-year per- 
iods. (Approximately ^50 of the program graduates are now working in 
New Mexico and about 200 are employed in California.) An employer fol- 
low-up is conducted in instances where former students give their con- 
sent for this to be done as they complete their one and five-year 
follow-up forms. (Note to the reader: Also, this is the only program 
among those site "isits conducted which has a systematic, data-based 
follow-up program for both former students and employers.) Jhere is 
no formal placement program, however; students are responsible for get- 
ting their own jobs after graduation. 



LIMITATIONS 

The major limitation pointed out is that clinical performance 
tests are needed .to assess former students* competence in hospitals 
upon course completion. If such tests were available, this would be an 
important input into course evaluation and subsequent curriculum re- 
vision. 



STRENGTHS 
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